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Employee Attitudes and their Relation to Morale * 
Walter A. Woods 


Syracuse University 


To meet the need for a more thorough understanding of morale in 
business and industry—a need demonstrated by labor turnover and recur- 
ring job dissatisfaction—this study of morale was undertaken in the Fall 
of 1938. Various phases of this problem were examined during the fol- 
lowing four years until the study was brought prematurely to a halt in the 
summer of 1942. This study was contemplated with the idea of con- 
structing an over-all scale for the measurement of morale, based on the 
assumption that morale was best measured by various attitudes. 

Morale was defined as the liking or disliking, in some degree, the 
various situations that arise in the process of working with others. It was 
presumed that degree of morale was represented by attitudes expressed in 
terms of like or dislike of the various factors of a man’sjob. As the study 
progressed it became apparent that reactions are not always related to 
what appear, on the surface, to be apparent causes. Various facts 
brought out, and opinions expressed during the progress of the study indi- 
cated that some theoretical considerations of the term ‘‘morale’”’ were 
necessary in order to obtain a more comprehensive picture of the subject. 
A change in thinking is reflected in the following study. It is now appar- 
ent that a study of morale must begin, not with attitudes toward work or a 
job, but with attitudes toward social values. 


Method Employed 


The first step undertaken was the construction of a scale by which 
to measure morale. After considering various techniques of attitude 
measurement it was decided to use the Thurstone technique (18) of just 

* The writer is indebted to: Dr. Herman C. Beyle, Maxwell School, Syracuse Uni- 
versity, for aid and suggestions in construction of the scales, Dr. Harold M. Hildreth, 


Department of Psychology, Syracuse University, for criticism, and Dr. E. K. Strong, Jr., 
Stanford University, for his suggestions in the revision of the manuscript. 
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noticeable differences. This method was selected because it was believed 
that the final results would fall along the type of continuum described by 
Thurstone and by Chaves (19). That is, it was believed that the final 
results could be reduced to numerical values—statements drawn from 
social usage which would fall into scale positions along a continuum. 

The general Thurstone technique was employed. A large number of 
statements were obtained from employees in various jobs. These state- 
ments were unselected, run-of-the-mill statements representing all de- 
grees of attitude toward all phases of typical jobs. These statements 
were culled, edited, and arranged into groups pertaining to various phases 
of a work situation, e.g. rate of pay, supervision, etc. A preliminary scale 
of fifty-three groups—427 statements—was devised. 

The Preliminary Scale was submitted to 200 raters. Each was in- 
structed to rate from 0 to 10, the degree of morale which he believed was 
represented by each statement. All raters were employed in some type 
of work involving working with others with some degree of supervision. 
Some were supervisors of the highest category. Others were lesser super- 
visors. Most were the general run of employee. All were employed in 
private industry and in government throughout the following sections: 
New England, New York, the Atlantic Seaboard, the Midwest, and the 
Rocky, Mountains. Of the 200 ratings requested sixty-eight were re- 
ceived in satisfactory form. Many were discarded because they were 
either incomplete or because the rater obviously had misunderstood what 
was required. 

The percentile graph was used in the statistical treatment of the data. 
This method was employed tc determine scale position and ambiguity 
of each statement. Scale position was represented by the fiftieth per- 
centile, ambiguity by the semi-interquartile range. After the values had 
been determined all statements with Q’s of 3.0 or more were arbitrarily 
discarded as having a meaning which was not clear. Groups of state- 
ments were then examined to determine which included opinions ranging 
from both extremes or near extremes. Groups with narrow ranges were 
not retained. Groups with ample range were examined to determine 
whether representative degrees of opinion were included. Of the original 
fifty-three groups, seventeen were retained for use in a further test. 

These seventeen groups hereafter referred to as job segments were 
prepared in scale form. The scale is as follows: 


Job Segment Evaluation Scale 


This scale is designed to analyze the attitudes of employees in various jobs. 
Each of the following statements represents a numerical value indicative of a 
degree of attitude. We are not interested in individual attitude measurement 
in this case; therefore you are asked not to write your name on this form. 
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You are asked to check the one statement in each of the following groups 
which most closely represents your opinion on the subject. 


Scale 
I Value 


I feel that I receive too many instructions that are meaningless. 
There is no use following all instructions too carefully for some super- 
visors do not understand the details of the job. 


. Our supervisors always appreciate the employee’s point of view regard- 


ing instructions. 


. One should call the supervisor’s attention to points which the instruc- 


tions do not cover. 


. There are many times when one needs to do what is best at his own 


risk when instructions are inadequate. 


. If instructions conflict the employee should seek the advice of his im- 


mediate superior at once. 


. If instructions are not carried out one should promptly explain to the 


supervisor. 


. If instructions conflict the employee is justified in ignoring them and 


continuing as he has always done. 


. Instructions are often unimportant and should not be taken too 


seriously. 


. Instructions don’t mean a thing for the supervisors do not know the job. 


II 


. It will benefit an employee to assume responsibilities whenever possible. 
. It is always a pleasure to assume responsibilities here. 
. In the best interest of the organization an employee should always 


assume any responsibility that is necessary. 


. The supervisors rather than the employee get paid for taking on 


responsibilities. 


. It is to the employee’s best interest always to assume responsibilities 


when necessary. 


. The officials do not expect employees to assume responsibilities so they 


shouldn’t assume any unnecessary risks. 


. It makes little difference to the supervisor whether or not an employee 


takes over additional responsibilities. 


. An employee will gain nothing by assuming unnecessary responsibility. 
. It is always best to let others assume responsibilities for nothing is 


gained by taking unnecessary risks. 


. It would be to the employee’s advantage, not only to make decisions, 


but to assume responsibility for his decisions in the absence of a 
superior. 
Ill 


. Employees here are always anxious to make constructive suggestions 


about their work. 


It is generally to the employee’s advantage to offer suggestions for 
improvement of the organization and its work. 


. There are times when constructive suggestions are appreciated. 
. Constructive suggestions would not be appreciated here. 
. It is not worth while to offer suggestions on how to improve the work 


IV 


. Our supervisors are capable men. 
. If the supervisors were more capable they wouldn’t be criticized so 


much. 


2.7 
2.3 
7.9 
8.0 
7.6 
8.3 
7.7 
2.5 


1.3 
0.3 





EN dae BS het NO AA TILT A I ES 











—_ 


JI OQorwnd- 


Noo PoNE 


3 
4 
5 
6. 
te 
8. 
9 
0 


1 
. The officers are a bunch of politicians. 1. 
. The officers would be better liked if they weren’t a bunch of capitalists. 0. 


. It makes very little difference whether the employee shows interest in 
. It is to the employee’s interest to keep acquainted with the plans of 


. I can’t be bothered with so-called plans of the management. 


. The work we are doing is really a great service to mankind 

. Our work is really a racket. 

. Out work is not so important but somebody has to do it. 

. The public should be encouraged to support the work we are doing. 

. The work we are doing is one of those necessary evils. 

. It is only fair to advise the public that there are better ways of investing 


. The work we are doing is not very essential. 


. It is a pleasure to do favors for fellow workers here. 
. An employee should, if necessary, go out of his way to help fellow 
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Scale 
Value 


. Our officers are the very best men for the job. 8.6 
. The officers have earned their positions by being good administrators. 8.5 
. Most of the officers are good men but there are a few who aren’t. 


6.9 
Officers are just like anyone else; some are good and some are bad. 6.5 
There are a few good fellows among the officers. 4.7 
The officers would be better liked if they didn’t act like they were so 
much better than anyone else. 0 
0 
7 


Vv 


. It will help the organization if the employees try to keep acquainted 


with the plans of the management. 


o oo 


the plans of the management. 


8. 
2. 
the management. & 
0. 
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their money than here. 
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employees. 7.6 


. Employees should do favors for each other. 7.3 
. It is all right to do favors for fellow employees if they have done one 


for you. 4.9 


. It is best to let fellow employees know that they cannot expect favors 


from you. 1.9 


. If you start doing favors for fellow workers you will soon be imposed 


upon. 


1.3 
. It is all right to do a favor for a fellow employee now and then. _ 


Nothing is gained by doing a fellow employee a favor. 
Vill 


. It is a pleasure to be courteous to the kind of employees we have here. 
. It is wise to treat fellow employees courteously. 


There is no need to be particularly courteous to fellow employees. 


. It doesn’t do any harm to speak to fellow employees but it isn’t 


Fellow employees here deserve to be snubbed. 
It is wise to treat fellow employees courteously when the officers are 
around, but otherwise it isn’t necessary. 


9.0 
8.0 
2.3 
necessary. 2.6 
0.3 
0.4 
It is best to avoid speaking to fellow employees as much as possible. 1.2 
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. Employees should be courteous to the public whenever possible. 
. Some of the folks who come into this office are pests and you can’t waste 


. In dealing with the public you just have to make it snappy or you will 


. There is no “quitting time” on an employee’s duties to make the public 


. L like the work here because it is so interesting. 
. There is absolutely nothing interesting about the work here. 
. The work is so monotonous I’m glad to forget about it after quitting 


. L really hate this job but what can one do about it. 

. I wouldn’t change jobs with anyone. 

. I would like my job better if there were any future in it. 

. An employee here cannot be blamed for looking for a better job else- 


COND oF WH 


. There is no reason to object to a job in this organization. 
. The future possibilities of this job are unlimited. 
. This is a good chance for a career. 


. This organization offers ideal opportunities for a career. 
. As a career this job has absolutely nothing ‘to offer. 
. The career boys here are the ones with a drag. 
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Scale 
Value 


. It helps bring fellow workers around to snub them now and then. 0.6 


. In the long run it is best to ignore fellow workers as much as possible. 0.4 
10. 


11. 


It is generally a good practice to be courteous to fellow workers. 7.3 
It is against the best interests of the organization to be rude to fellow 

employees. 8.0 
It is very rude to ever snub a fellow worker. 7.8 


IX 


Employees must always be courteous when dealing with the public for 
the organization’s reputation and good name largely depend on these 
contacts. 


go © 
- © 


too much time on them. 

It really saves time and trouble to explain things fully to everyone who 
has dealings with the organization. 

We are all proud of our organization and its work and are anxious to 
have the public think well of us.« 


so. 
Go 


never get your work done. 


eo - © 
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understand and like the organization and its work. 


x 


time. 


This work is so trying I am really glad when it is time to quit. 
I wish something could be done to make this work a little more in- 
teresting. 
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where. 
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XI 


. Political pull rather than training makes for advancement here. 1.5 
. The management makes it worthwhile for an employee to improve his 


training. 8.0 


. The management offers the employee unlimited opportunity for 


training to improve his work and service. 8.9 


. There is little use in bothering with outside training for the manage- 


ment has most of us pegged where it wants us. 1.1 
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. Employees here are well paid in proportion to their ability. 

. The best way to get a raise is to tend to business. 

. You never get a raise here until you ask for it. 

. Some employees here are paid according to their ability but others are 
. The employees would be better satisfied if they were paid on the basis 
. If an employee feels he isn’t getting what he is worth it would be to his 


. The most able employees are not always the best paid. 
. Working overtime without pay is all right once in a while, but that 


. We are always glad to work overtime for extra effort is always recog- 


. Our working conditions here are ideal. 
. Working conditions here aren’t sq bad. 
. There are many things that can be done to improve our working condi- 


. How can the management expect us to get anything done under the 
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. Working conditions here are about the same as anywhere else. 


. Sometimes credit is given for good work here and sometimes not. 
. You may as well take advantage of the other fellows good ideas to get 


. You don’t get any extra consideration here anyway, so you may as well 


. The management is fairly good about recognition of work well done. 


. The best qualified people always get the promotions here. 
. More employees would stick with the organization if the chances for 


. The best qualified people do not always get the promotion. 
. It doesn’t pay to work hard for promotion here for there aren’t any 
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Scale 
Value 


. If one were interested in a career he would not stay here too long. 2.4 
. There is no use in my thinking of a career; things are set against me. 0.1 
. This work has many features which makes it worthwhile as a career. 7.7 


XIII 
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advantage to discuss the matter with the management. 


happens too often here. 
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XV 


. The employees here appreciate the credit that is gladly given by the 


management for good work. 


= 00 


credit for yourself, that’s what everyone else does. 


take credit for all you can whether you deserve it or not. 
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romotion were better. 
he chances for promotion are ideal here. 
Employees are always given plenty of opportunity for promotion. 
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opportunities anyway. 
So many young fellows get the promotions when they should go to those 
who have been here longest. 4.1 


. It doesn’t do a young fellow any good to work hard for the older men 


get the promotions anyway. 1.7 
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Scale 
Value 

9. There are a few opportunities for promotion, but generally they aren’t 
so good. 3.2 

10. It seems to make little difference whether an employee works hard to 
earn a promotion. 1.9 
11. Promotions are a matter of luck and political pull. 0.9 

12. Anyone is foolish to refuse a promotion even if he knows he isn’t fitted 
for the job. 2.7 
13. If a fellow isn’t fitted for the job he should refuse a promotion. 6.1 

XVII 

1. An employee should always try to keep outside influence from affecting 
his work. 8.3 

. An employee has outside problems, too, and the management should 
expect them to influence his work occasionally. 3.9 

. The management has been very considerate on occasions when I was 
having problems and worries outside the line of duty. 8.5 


The management doesn’t care what happens to the employees outside 
their line of duty. 

. There is nothing the matter with the job here, I am just worried by 
some conditions outside the line of work. 

. I haven’t been able to do my best because so many other matters were 
troubling me. 3.9 


| eS) 


This scale or test was submitted to forty-two full time, permanent 
federal employees. All employees were performing similar work and 
were receiving approximately the same rate of pay. All were employed 
by the same agency in various field offices. Each employee was instructed 
to select the one statement in each group which most closely represented 
his opinion on that aspect of his work. Steps were taken to assure that 
individual scores would remain anonymous. 

The results of these ratings were then examined to determine: (1) 
whether there was any relationship between an average score for an 
employee and his individual scores; (2) whether there were any particular 
aspects of the job that were rated high or low or around any modal value 
and; (3) whether any employee tended to rate all statements high or low 
or around any central value. The mean value of the rating of each em- 
ployee was determined and was correlated with his individual scores. 


Results 


Scale values of the original 427 statements were found to be distributed 
over the entire continuum established. Table 1 shows the distribution of 
these scores. There are adequate scores in each position to provide for a 
complete range of measurement of the seventeen aspects (groups) retained 
for use in the final scale. The range of scores on the final scale is from 
0.1 to 9.4. 

The standard deviation of the means of ratings of each job segment 
indicates that considerable variability existed among the employees 
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Table 1 


Distribution of the Scale Values of All Statements Included in the Preliminary Scale 

Note: The following table shows distribution of scores of all statements included in the 
preliminary scale. The row at the top indicates units along the continuum. The 
column at the left indicates tenths of units. 





—0 
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4 5 6 7 8 9 10 
0 x 1 9 8 12 3 7 x 2 15 4 x 
a 1 1 2 9 6 3 2 2 5 3 2 
2 1 x 3 5 5 5 1 4 3 2 x 
a 3 13 9 8 3 1 1 6 9 x 
A 6 6 5 4 4 1 4 4 7 1 
a) 8 4 10 3 4 2 2 5 5 
6 7 5 9 3 3 3 2 6 6 
7 6 6 8 5 2 2 2 4 8 
8 3 5 2 4 4 x 1 6 7 
9 5 9 4 7 1 1 4 7 6 
Totals 2 40 62 69 57 32 20 22 48 68 7 0 





tested. There is no indication that relationship exists between the num- 
ber of statements in the group and variability of the scores. These values 


are included in Table 2. 
Table 2 


Standard Deviations of Job Segment Mean Scores and Coefficients of Correlations of 
Employee’s Average Scores Compared with Their Scores for Each Segment 








Standard Coefficients of 
Group Mean Deviations Correlation 
1. Instructions 7.7 4 48 
2. Responsibilities 8.6 3 04 
3. Suggestions 7.8 1.9 All 
4. Supervisors 6.3 2.8 .69 
5. Plans 7.4 1.5 .79 
6. Nature of work 8.3 2.3 .39 
7. Favors 6.3 1.8 19 
8. Courtesy 7.3 2 .40 
9. Public Relations 9.0 1 All 
10. Interests 7.0 2.7 .76 
11. Advancement 6.8 2.9 .92 
12. Career 7.0 2.9 82 
13. Pay and Ability 5.4 2.9 50 
14. Working Conditions 5.2 1.5 53 
15. Recognition 6.5 2.2 63 
16. Promotion 5.0 2.0 51 


17. Outside Influences 7.6 1.4 .00 











sc) 
lop) 
N 


Employee Attitudes and Relation to Morale 

















18 89 18 a bP c’9 92 Lg 1'8 a PL 08 62 ¢'¢ uve seAo[dury 

OL e's e's £8 e's $8 «6S €'8 €'8 S8 89 89 £8 £8 c's seouenpuy epis}ng 
o¢ cS 47 98 WSS ST ST ST ST 16 JY oY oY oY 28'S uolyOUOL 
¢’9 68 «8&7 68 TL SY 89 68 «87 68 S&F +7 68 68 +87 uor}UFO0IIY 
2s 97 067 297 8Y OT 297 299 99 fF 299 299 299 299 28°7 SUOT}IPUOLD BULFIO MA 
vg £8 «6S £8 SL «5S #5°S ef «TO rs e387 a7 «82 +07 a7 Ayyiqy pus Avg 
OL aL L 68 «Ll ZL Sl LL } So oY LL ZL eb whi 2fO I90IBl) 
89 +08 0s +08 O08 -«I'T 08 08 +971 08 6'8 6'8 6'8 68 «IT qUOTIBIUBAPY 
OL Lg «68 £8 WY +90 Ce tT - ST 6'8 68 16 6'8 16 «77 838010} UT 
06 06 06 06 16 06 06 88 06 06 06 88 88 06 06 SUuOIPBpeY IGN 
Ll +0°8 06 +08 Sl SL Sl SL rt. As 9L 08 08 08 Sl Asoynor 
£9 OL SY 292 2 OL +87 92 6T +821 el Th. ho We el SIOAB 
€'8 88 88 7% 88 88 88 88 38 88 88 88 88 88 +6 YOM JO OINGVN 
VL +08 rl 208 OS +83 08 0'8 rh +08 08 08 08 0's rl Suvi 
9 LS 2I@ L's C9 I C9 1G ¢'9 c's ¢'8 Lg c's CS «IB suostaredng 
SL e'8 62 e'8 8 +18 €'8 €'8 8 £8 *8 6L 8 e'8 6L suolysed3ng 
9°8 Pe | |[UMGe 6'8 $8 &'8 88 Lh 8'8 88 88 88 88 78 8 sarztiqisuodsay 
Ll +62 LL «62 $8 +6 £8 £8 08 £8 62 $8 +62 6L 62 suoTzONIySU] 

uve PI €1 ZI Il ol 6 8 l 9 ¢ t £ Zz I quowiseg 

quoul 

-3ag seoAo dug 





sqor 11043 JO syoedsy use}UeAeg UO BDO B]FuIg B Jo seeAO|dWIG Uuse}INOY JO sel0dg |eNpiAIpuy 


€ P98 L 





H 
4 
{ 
f 





{ 
| 


294 Walter A. Woods 


Coefficients of correlation were determined to indicate the relationship 
between the average scores of each employee and his score for each seg- 
ment. Coefficients which were obtained indicate that the correlation 
between mean score and Job segment score is preponderantly low. Cor- 
relation coefficients are included in Table 2. 

Table 3 was prepared to show individual scores for a group of em- 
ployees in a single office. This table shows the score of each employee 
for each group of statements. Averages for each employee and for all 
employees for each statement are indicated in appropriate positions. 
Individual scores which fall below the individual’s own average score are 
marked *. Scores which fall below the mean for the Job segment are 
italicized. It will be noted from this table that segments relating to pay 
and ability, working conditions, credit for good work, and promotion 
have been given comparatively low scores. These scores tend to rate 
low when compared with employee averages and tend to fall below Job 
segment averages. 


Discussion and Observations 

As the study progressed it became increasingly apparent that a more 
exact definition was required to describe the condition that was to be 
measured. The work of securing the preliminary ratings brought the 
experimenter into constant contact with employees, personnel men and 
management. All criticised the study—favorably and otherwise. The 
most general comment was to the effect that while a scale of the type 
under construction might very well measure attitudes toward aspects of 
a work situation, it did not necessarily follow that it would measure morale 
since many of the aspects included did not relate to morale. It was 
significant that there was no general agreement among critics as to what 
aspects did or did not relate to morale. Some critics, for example, con- 
sidered any opinion as to rate of pay a matter of fact—pay was either too 
high or too low—but considered an attitude toward supervision a matter 
of morale. Others offered a directly opposite point of view. One fact 
was apparent. There was no general acceptance of the idea that morale 
was the liking or disliking of any particular aspect or group of aspects 
(or situations) of working with others. Rather, there was a consensus 
that there can be any number of reasons why an employee might be dis- 
satisfied with his salary, or his supervisors, or his promotion, or any other 
factor related to his work. Further, the cause might be entirely unre- 
lated to the work: it might arise from domestic difficulties, social problems, 
health, love life or anything else. It was consistently pointed out that 
dissatisfaction on any job, or toward any aspect of a job might be caused 
by low morale; that the dissatisfaction expressed might not be the cause 
of the low morale. This reasoning is not unsound. The fact exists that 
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an employee may have the very highest of morale, yet feel that he is un- 
derpaid. He may also feel that his supervisor is open to criticism yet 
have the highest of morale. The same may apply to any factor in his 
job. As well, an employee may have the lowest degree of morale caused 
by some factor not related to his work, yet he might honestly express 
attitudes toward his work that would indicate high morale on a scale of 
this type. 

The confusion regarding the nature of the term ‘‘morale’’ is apparent. 
“Just what is morale?” was a question not infrequently encountered. Is 
it an opinion—an expressed attitude? It is performance? What type 
of activity exemplifies high or low morale? What does it mean to those 
who discuss morale? What is its social meaning? 

Primarily it was necessary to arrive at an understanding of what the 
term was customarily meant to convey. Were we measuring the thing 
that the term was generally meant to represent? Some semantic con- 
siderations are necessary in order to clarify this situation. 

The military writers have assumed that morale is a known and under- 
stood term; that it implies some human quality which prompts a soldier 
(or other individual) to produce at maximum output, or which enables 
the individual to resist extreme hardship. Further, it is a quality without 
which the individual cannot reach maximum efficiency nor withstand 
extreme hardship. 

Concerning morale, Field Marshall Montgomery-Massingbred (11) 
tells us “. . . every great leader has made the study of human nature his 
first task, in order to get the best out of his subordinates. . . .’”’ Concern- 
ing improving morale he states, ‘‘We embarked on this war for the liberty 
of small nations, but it soon became evidence that we were fighting . . . 
for ourselves, and . . . we were fighting for our very existence.’”’ The 
accomplishment of high morale is reached, he finds, through discipline 
which is “a spirit of self-effacement . . . so that we may get maximum 
results from the combined efforts of a body of individuals whether they 
form a platoon . . . or a nation.” 

Much has been written of the morale of the German army in early 
campaigns. Concerning these campaigns we are told by Lieut. Minto 
(10), “In fine, a nation’s victory is solely dependent on the morale of her 
forces. . . . The prevailing unemployment in the Reich had borne par- 
ticularly hard . . . and many young men . . . came to look on an army 
career, with its reasonable security and freedom . . . as exceedingly 
attractive. 

“From the start of a soldier’s career, one idea was drilled into him, and 
that was that he must look upon himself as the embodiment of the highest 
qualities of his race . . . the discomforts suffered by a Reichswehr soldier 
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were severe but he was taught that he was privileged in being allowed to 
undergo them. He was a picked man, and in his hands lay the glories of 
the past.” 

William L. Shirer commented on this morale in his Berlin diary (17): 
‘“‘The second consideration is the fantastically good morale of the German 


Army. I remember my surprise . . . to find an entirely new esprit in 
the German navy. This esprit was based on a camaraderie between 
officers and men. . . . The German officer no longer represents—or at 


least is conscious of representing—a class or caste. And the men in the 
ranks feel this. . 

“One reason for the excellent morale of the troops is their realization 
that they and not the civilians back home are receiving the best treatment 
the nation can afford.” 

In a military sense morale is considered to be a force compelling and 
directing toward the attainment of some specific goal. Social causes are 
implied in the background of what military men consider to be driving 
forces. The individuals or groups are willing to undertake extreme risk 
and to undergo extreme hardship to attain or secure some particular 
sociological fact or possibility; their existence, a place in the sun, etc. 
Physical conditions, rates of pay, food, etc. are not represented in the 
picture as predominant factors. If we refer back to Shirer’s comment, we 
note that physical conditions of German soldiers are not described as good 
but as “the best that the nation can afford.”’ Lieut. Minto noted the 
severity of the discomforts and the fact that morale lay in the privilege of 
being allowed to undergo them. 

Morale, as the term is used in industry, differs very little from the 
military conception. The principal difference lies in the fact that there 
has been a tendency in industry to give more weight to the influence of 
purely physical factors as effectors of morale. Kouisted (7), for example, 
found that a scale for the measurement of morale should provide for ‘‘(1) 
a measure of general overall job morale (2) the opportunity for the 
employee to express his attitude on a large number of specific points con- 
cerning his job and (3) for an evaluation of the specific attitudes and 
beliefs in terms of their correlation with general morale.’’ This definition 
carries the implication that morale is somehow related to the employees 
attitude concerning specific factors of his job. 

Professor Robert Davis defines morale as “‘a mental condition which 
leads individuals and groups willingly to subordinate their personal ob- 
jectives, temporarily, and within reason, to further the company service 
objectives” (16). The most pertinent question to be raised here, is 
whether there is ever any actual subordination of personal desires without 
a compensating social value, either real or presumed. This definition 
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does not provide for the possibility that by subordinating immediate 
personal objectives to the company’s progress the individual is, in fact, 
furthering his own long range objectives. 

The following definition compares favorably with the militaristic idea 
of morale. This is a business man’s definition. ‘Morale is an intangible 
force that enables a group to achieve the unexpected when marshalled in 
behalf of a specific goal.’”” The same source further describes morale as a 
by-product of a satisfactory group relationship. 

Our definition implies that morale is either a many featured complex— 
that an employee may have several morales, or that an employee’s morale 
is the sum of his attitudes toward a number of aspects of his work. There 
is in the second alternative the inescapable implication that an employee’s 
morale must include all aspects of his work. If we make any other 
assumption, then we further assume that we know what certain elements 
of his job do or do not denote with respect to morale. Any other connota- 
tion must include the recognition that either we do not know what elements 
of a job denote morale, or as a matter of fact, whether any aspects denote 
morale. We can, however, make another qualification to this second 
alternative. We may include the possibility that different situations 
denote or influence morale in different employees. This further qualifica- 
tion carries with it the correlary that no one particular aspect of a job is 
necessarily a morale denoting factor. To carry this reasoning to a con- 
clusion: if we cannot look to specific aspects of work for origins of morale, 
we must then look to the individual and his social situation (including 
his work) for the origin. 

Reasoning from our first alternative two possibilities must be ac- 
knowledged: First, if morale is a many featured quality we are not, in 
fact, measuring one thing but several and, second, we have not yet reached 
the point where we know which of several aspects of a job denote morale. 
A measurement of the type we have undertaken is not, in this light, a 
measure of morale, but a measure of morales. Each morale, to be meas- 
ured, must be identified. It must be recognized that a measure of 
“morales” is not a measure of hor an indication of relationship between 
the several morales. Support for this position is found in our results. 
Coefficients of correlation between the individual Job segment scores and 
employee scores indicate that there is little recognizable relationship. 
These correlations run from .00 to .92. Inspection of these aspects which 
do have high coefficients reveals that the factors dealt with are worth- 
whileness of training and opportunity for a career. Both of these seg- 
ments will bear further study as independent factors since neither is 
specifically a physical factor of a work situation, but a social situation 
related to the work. The fact that high correlations do exist here does 
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indicate there may be a definite relationship between a person’s evaluation 
of his future prospects in terms of his immediate situation; it is not un- 
likely that these correlations are meaningful in this respect; or these 
correlations may be fortuitous. In general, however, correlations tend 
to be low. These correlations invalidate the mean score of Job segment 
ratings as a useful score in the measurement of morale as implied in our 
definition. Our results do not support our definition: that morale is the 
liking or disliking in some degree the various factors that arise in the 
process of working with others. Rather, it is indicated that morale is not 
exclusively a sum of attitudes toward work situations. 

Our results tend to support the position that causes or origins of 
morale are to be found somewhere else than in specific work factors. 
Table 3 shows the scores of a group of employees working under very 
similar conditions. The scores show that in a group of employees working 
under almost identical conditions, scores vary greatly. The only facts 
that we may draw from these results are (1) that employees differ in their 
opinions of similar situations and (2) that with respect to certain factors 
employees tend to indicate agreement of opinion. Certain employees 
tend to rate generally high and others generally low. However, there is 
the fact that the lowest scores for both the high score employees and the 
low score employees tend to be associated with the same factors of work 
in many instances. In other words (assuming that these scores were a 
measure of morale) the employees with the lowest morale and the em- 
ployees with the highest morale both think about the same with regard 
to many factors in their work situations. Morale, then, does not neces- 
sarily lie in the work itself. 

The study conducted at the Hawthorne Plant of Western Electric 
Company has contributed an abundance of material relative to the in- 
fluence of factors in the work situation. Some of the significant findings 
are indicated in the following direct quotations of the experimenters (15.) 


“At least two conclusions seem to be warranted from the test room experi- 
ments so far: (1) there was absolutely no evidence in favor of the hypothesis 
that the continuous increases in output . . . could be attributed to the wage 
incentive alone; (2) the efficacy of a wage incentive was so dependent on its 
relation to other factors that it was impossible to consider it as a thing in itself 
having an independent effect on the individual.” 

“. . . From this point of view it can be seen how every item and event in 
the industrial environment becomes an object of a system of sentiments. Ac- 
cording to this way of looking at things, material goods, physical events, wages, 
hours of work, etc. cannot be treated as things in themselves. Instead they 
must be interpreted as carriers of social value.” 

“When social conditions of work are such as to make it difficult for the 
employee to identify his task with a socially meaningful function, he is liable 
to obsessive response and diminished capacity for work.” 
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The present results are significant in terms of the above study in that 
we find that the nature of morale cannot be attributed to any single factor 
or group of conditions of a work situation. Our study shows that em- 
ployees express different attitudes when features of the work are similar. 
Our study has afforded no opportunity to study the significance of social 
activity in terms of meaningfulness of work. However, the importance 
of this is borne out in almost all of the literature used in this study, and 
must be considered to be an object of further study. We found that a 
composite score of a group of selected factors had little relationship to 
scores of individuals. The Western Electric study found that it is useless 
to attribute behavior as responses to specific physical conditions. 

Our study has not, however, discredited the use of a scale of this type 
for purposes of measuring attitudes on work factors. In fact, a possible 
use of a scale of this type has been indicated by the assumulation of scores 
in Table 3. In this table all scores below the mean for the column (in- 
dividual mean) are marked *. All scores below the mean for the row are 
italicized. It will be noted that scores starred and italicized tend to 
arrange themselves in rows and columns. In a number of instances not 
only are a majority of the scores below the average of the segment itself, 
but they tend to be below the mean score of the individual employee. 
Both *’s and italics are found for a majority of scores for items 13, 14, 15 
and 16 respectively relating to pay and ability, working conditions, 
recognition, and promotion. These scores indicate that, regardless of 
how low an employee tends to score in his average score, he tends to score 
lowest on these particular factors. Similarly, items 2, 6, and 9 relating 
to responsibilities, importance of work, and public relations indicate that 
regardless of how high an employee tended to score on the average, he 
scored highest on these aspects. An analysis of groups of scores, not mean 
values, will indicate to a management how his employees are thinking 
with respect to specific details of the job—what features are considered to 
be satisfactory, and what are unsatisfactory. The value of this type of 
analysis lies in the fact that management will have a starting place with 
which to work if experience has proven that morale islow. There doesn’t 
seem to be much question but that low morale can be recognized without 


a measuring scale. A good judge of human behavior can distinguish 
morale. 


Summary and Conclusions 
In summarizing the observations and information gleaned from this 
study, attention is directed toward two products of the study. First in 
the work of the preliminary scale a number of aspects of employment 
situations were subjected to the judgment of raters to determine whether 
attitudes toward these features would lend themselves to measurement. 
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From the information secured and the values derived a test scale was 
constructed and submitted to raters. This study has demonstrated, 
within the limits of the statistical reliability that can be placed on a 
limited number of samples, that attitudes of employees toward their 
work can be measured in terms of numerical values which may be assigned 
to statements of experiential meaning. We may further conclude that 
values derived from representative evaluations of workers fall along a 
continuum between arbitrary limits of high and low. Such a scale has 
value in the fact that it will reveal to managerial groups the mode of 
opinion of groups of employees toward various attributes of their jobs. 

The other product of this study has been some slight contributions 
to an understanding of morale; its social (and semantic) meaning and its 
implications. We find that morale has been loosely used in a general 
sense, but that its meaning is universally understood in terms of end result. 
From military sources comes the opinion that morale is represented by a 
willingness to make extreme sacrifice in exchange for the possibility of a 
certain amount of glory or for some meaningful end. The militarists 
attribute the origin of morale, however, to other effectors such as disci- 
pline and leadership. Industry places emphasis on the idea that morale 
is an all out effort to accomplish something, but relies on the idea that 
the effector is working conditions. The exception is found in the Western 
Electric study which points to the inescapable conclusion that when 
special efforts are displayed by employees, these efforts come as the result 
of orientation or direction toward some social meaning. 

The immediate results of our own tests indicate that an average score 
of attitudes toward several aspects of a job has no meaning in terms of any 
individual aspect but may be an indication of a general morale factor. 

We must conclude that our original definition; morale is the liking or 
disliking, in some degree, the various situations that arise in the process of 
working with others, does not describe morale. Rather, morale is a term 
that is used to describe special effort or willingness to make extreme effort 
or sacrifice for the purpose of securing some social value or fact. Used in 
this sense morale is not high or low but is either present or absent. (The 
argument may be advanced that morale may be present or absent in 
varying degrees. This may be true. It is merely desired to point out 
that what is generally understood to represent morale is either evident or 
is not evident. In the socially understood sense, it is either present or 
lacking.) 

This study suggests that further studies in morale should be conducted 
along lines designed to demonstrate (1) what is really meant by morale 
(2) the effectors that cause or give rise to morale (3) the social values or 
attainment goals of individuals or employees as related to work results and 
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(4) the effect that various aspects of his job have on the attainment of an 
employee’s social goals or his prestige. It is clearly indicated that no 
definite understanding has been reached as to what morale is. This must 
be done before morale can be measured. 


Received July 14, 1948. 
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A Brief Study of the Humm-Wadsworth Temperament Scale 
and the Guilford-Martin Personnel Inventory in an 
Industrial Situation 


Roy M. Dorcus 
Department of Psychology, University of California at Los Angeles 


In view of the limited data available in the literature on the applica- 
tion of the Humm-Wadsworth Test in industry, and in view of the num- 
erous inquiries that have been made by industrial concerns about its 
validity, it was decided that a brief study should be made in cooperation 
with Dr. Humm and with a concern engaged in the manufacture of air- 
craft parts. We hoped to answer three questions: (1) Can the test be 
objectively interpreted? (2) Does it have a reasonably high degree of 
validity in an industrial situation? (3) Do tests which are somewhat 
similar in nature tend to qualify or disqualify the same individuals? 

In order that these questions could be answered, certain individuals 
representing management were asked to select two groups of individuals 
about whom they had definite knowledge. One group was to be selected 
not on a basis of production but on a basis of the fact that they showed 
signs of maladjustment and discontent, or were problem employees. The 
other group was to contain only employees who showed no such behavior 
patterns. These two groups were selected by the company, but no in- 
formation as to the number in each group or the composition of each group 
was supplied in advance. These groups were mixed together for testing 
purposes and were given the Humm-Wadsworth Test followed by the 
Guilford-Martin Test on the same day. They were told that the com- 
pany was interested in developing future hiring procedures and that the 
results of the test would not jeopardize their positions in any way. In 
addition, they were paid for the time involved. 

Since the Humm-Wadsworth Test is familiar to the majority of psy- 
chologists, data concerning its construction and purpose are omitted. 
The Guilford-Martin Test is relatively new and a brief description is 
included so that the reader will have a better opportunity to follow the 
later discussion. The Guilford-Martin Personnel Inventory No. I con- 
tains 150 items which personnel practice had indicated would distinguish 
desirable from undesirable workers. These items were subjected to factor 
analysis methods to determine the basic factors involved. An inventory 
was constructed to measure these unitary traits and three scoring keys 
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were developed through item analysis methods. These three traits may 
be described as follows: Co—Cooperativeness as distinguished from fault- 
finding. At the one extreme of the trait the individual thinks people and 
things are all right and at the other extreme he is hypercritical of every- 
thing and everybody; Ag—Agreeableness as distinguished from domineer- 
ing belligerence in which the individual is over-ready to fight; O—Objec- 
tivity toward the self as distinguished from subjective attitude in which 
everything is taken personally. Standardization cases consisted of work- 
ers in commerce and industry between the ages of 21 and 45 with equal 
numbers of each sex. Occupations ranged from unskilled to highly 
technical. 

The Humm-Wadsworth Test was then scored in accordance with the 
printed instructions furnished by Dr. Humm. Profiles were drawn and 
interpretations were made independently by the author and Dr. Humm. 
Of the 48 cases studied, there was complete agreement between us on 40 
cases. There was a disagreement on 4 cases that seemed to be only a 
matter of language, so that it is safe to report that on 44 cases we were in 
agreement. On the final four cases we were diametrically opposed in 
our interpretations, but this was due to the fact that a supplementary key 
had not reached me at the time of my final interpretation. After going 
over this additional information with Dr. Humm, I feel that I would have 
made the same interpretation that he did. The first question then can be 
answered affirmatively. That is, a scorer who possesses the scoring keys 
and manual of interpretation of profiles can interpret the Humm- 
Wadsworth Test in an objective fashion, even though the scoring and 
interpretation are quite laborious. 

The validity of both of the tests in picking out the problem employees 
was determined on a basis of the two groups mentioned previously. In 
order to avoid one of the criticisms that is frequently directed against the 
interpretation of test results, no middle ground interpretations or am- 
biguous interpretations were accepted. Each individual tested had to be 
designated as acceptable or unacceptable for employment, so that we had 
only two categories of cases. The data are presented in Table 1. 

It should be pointed out that the two different group ratings are com- 
posites of two groups of people in management who were well acquainted 
with those rated. Both groups were not equally familiar with all cases 
but in every case in which a person was rated unsatisfactory several raters 
agreed; similar conditions obtain for the satisfactory employees. It is 
fairly evident then that we are dealing with two rather extreme groups of 
employees and our results must be interpreted with a considerable degree 
of caution since the large group of middle range employees has been left 
out of consideration. 
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Table 1 
Unsatis- Unsatis- Unsatis- Unsatis- 
factory factory factory factory 


Goome Grove Humm- Guilford- 
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Individual Sex Rating Wadsworth Martin 
1 M x x x 
2 M 
3 F 
4 F x xX 
5 F 
6 M 
7 M x x 
8 F 
9 F x 

10 F x x 
11 M x x 

12 F 

13 F x 
14 F x x x 
15 F x xX x 
16 F x x x 
17 F x 

18 M x xX 
19 M x x 
20 M x x x 
21 M 

22 F x 

23 F 

24 M x x x 
25 F x x x 
26 M x xX 
27 M 

28 F x 
29 F 

30 F xX x 
31 F x xX 
32 F x 
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Table 1—Continued 






























































Unsatis- Unsatis- Unsatis- Unsatis- 
factory factory factory factory 
se] Grou youu Humm- Guilford- 
Individual Sex Rating No.1 Rating No.2 Wadsworth Martin 
33 F 
34 F x x 
35 F x x 
36 F 
37 F x x x 
38 M x x x 
39 M 
40 M x x 
41 M x 
42 M x x 
43 M x x 
44 M 
45 F 
46 M x xX xX 
47 F 
48 M x x x 
Table 2 
Summary of Date in Table 1 
Number 
Group of Cases 
Rated Unsatisfactory by Rating 1 or 2 of Company 22 
Rated Unsatisfactory by Humm-Wadsworth Test 24 
Rated Unsatisfactory by Guilford-Martin Test 22 
Rated Unsatisfactory by both Humm-Wadsworth and Guilford-Martin 16 
Rated Unsatisfactory by Company and by both Humm-Wadsworth and 
Guilford-Martin ll 
Rated Unsatisfactory by Company and by Humm-Wadsworth 16 
Rated Unsatisfactory by Company and by Guilford-Martin 15 
Rated Unsatisfactory by both Humm-Wadsworth and Guilford-Martin 
but Satisfactory by Company 5 
Rated Unsatisfactory by Humm-Wadsworth but rated Satisfactory by 
Company 8 
Rated Unsatisfactory by Guilford-Martin but rated Satisfactory by 
Company 7 


i) 


Rated Unsatisfactory by Company but rated Satisfactory by both tests 
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If we assume the ratings to be correct then the Humm-Wadsworth 
Test selected correctly 16 out of 22 or 72.8 per cent of the poor group; and 
selected correctly 18 out of 26 or 69.2 per cent of the good group. The 
contingency coefficient between the company ratings and the Humm- 
Wadsworth Test is .39; corrected for broad categories .55; the equivalent 
r = .55.1 This indicates that in 95 chances out of 100, .31 < r < .72. 
The forecasting efficiency of r is 16.3 percent. The Guilford-Martin Test 
correctly placed 15 out of 22 or 68.1 per cent of the poor group and 19 out 
of 26 or 73.1 per cent of the good group. The contingency coefficient 
between the company ratings and the Guilford-Martin Test is .38; cor- 
rected for broad categories .54; the equivalent r = .54. This indicates 
that in 95 chances out of 100, .30 <r < .72. The forecasting efficiency 
of r is 15.9 per cent. Both tests placed correctly 11 out of 22 or 50 per 
cent or the poor group and 16 out of 26 or 61.5 per cent of the good group. 
Both these selected 5 cases as unsatisfactory which were not rated as 
unsatisfactory by company ratings; if these cases turn out to be unsatis- 
factory then the predictive value of the tests would be considerably 
enhanced. 

The second question, therefore, can be answered positively. The 
Humm-Wadsworth and the Guilford-Martin Tests both have a predictive 
value greater than chance. Certain cautions should however be noted. 
(1) This study dealt with only the extreme cases and if the middle range 
of cases were included the predictive value may be considerably reduced. 
(2) Since we do not know the distribution of desirable and undesirable 
employees in the total population we may disqualify too many good 
employees in order to avoid selecting a small group of undesirable em- 
ployees. For example, if we assume that out of every 100 employees 
there are 70 satisfactory employees and 30 unsatisfactory employees, the 
tests would eliminate on a basis of the extreme cases studied, 21 satis- 
factory and 21 unsatisfactory employees. If a study of the middle range 
of employees si:owed that the predictive value was decreased so that 60 
per cent of unsatisfactory employees and 40 per cent of the satisfactory 
employees were eliminated, then under the conditions stipulated above 
28 good employees and 18 poor employees would be rejected. 

With regard to the third question, the answer has already been partly 
givenin Table 1. The two tests agree on 16 out of the 30 cases designated 
as unsatisfactory by one or the other test, which leaves 14 cases on which 
they disagree. Of the 16 undesirable cases on which both agreed,11 were 
said by the company to be undesirable. Stating the matter another 

1 Some statisticians may object to the conversion of the contingency coefficient to r 


since our cases represent a broken series. In spite of this objection, the figures ob- 
tained may furnish a better understanding to some readers. 
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way, the tests if applied together would have eliminated 30 out of 48 
(62.5 per cent) of the total cases studied. If only those cases were 
eliminated un which both tests agreed then 33.3 per cent of the total cases 
would have been eliminated. However, agreement of both tests would 
have eliminated 50 per cent of the unsatisfactory group and 19.2 per cent 
of the satisfactory group. Irrespective of whether the tests agree with 
industrial criteria, they agree with each other in 68.7 per cent of the total 
cases. 

Although the tests show a fairly high predictive value when used alone, 
experience indicates that they should be used in conjunction with other 
types of tests such as intelligence, aptitude and interest. It is quite evi- 
dent that an individual may be well adjusted in one situation if properly 
placed, whereas the same individual if improperly placed may exhibit 
symptoms of maladjustment. 

Final conclusions should not be drawn until a more extended study in 
which the middle range of cases is considered, and until the factors in the 
Guilford-Martin Test are compared with the various components in the 
Humm-Wadsworth Temperament Scale. 


Received August 4, 19438. 











Leadership as Related to the Bernreuter Personality Measures: 
III. Leadership among Adult Men in Vocational and 
Social Activities * 


Helen M. Richardson and Nelson G. Hanawalt 
New Jersey College for Women, Rutgers University 


The present study is part of a series dealing with leadership as related 
to the Bernreuter Personality measures (1, 8), which opened with reports 
on college leadership in extracurricular activities (4, 6). It was found 
that college leaders, both men and women, are more dominant, extro- 
verted, and self-confident than non-leaders or than the norms, that they 
show a trend toward greater self-sufficiency than the control groups, but 
are not appreciably different from the controls in sociability (6). Analysis 
of specific questionnaire items on which women leaders differed signifi- 
cantly from non-leaders corroborated the above results, and raised some 
questions about the concept of sociability as it functions in the scale 
designated as F2-S (4). The purpose of the present study is to discover 
whether similar relationships hold true for adult leadership of an executive 
sort in vocational and social life. As we pointed out in the opening paper 
of the series, such a study may be considered from two points of view: 
(1) as an exploration of personality traits associated with leadership; (2) 
as a test of the validity of the Bernreuter scales. 


Method of Investigation 


As a means of securing adult subjects who would be willing to cooper- 
ate, we asked students in psychology classes to have their fathers, older 
brothers, or male acquaintances aged 26 or more fill out the Bernreuter 
Inventory and furnish some additional information for what was described 
as “a survey of certain interests and attitudes of men in various occupa- 
tions.”” Nonames were signed on any of the papers. The majority of the 
subjects were obtained in this way. A number of additional cases were 
secured by advanced students who undertook parts of this study as pro- 
jects for term papers, and by the authors. The total number of ques- 

* The authors are indebted to Miss Shirley Abromovitz, Miss Doris Harolds, Miss 
Sophy Hernandez, Miss Jean Kidd, Miss Bernice Kirson, Miss Helen Layton, Miss 
Marcia Lifshitz, Miss Margaret McClave, Miss Rita Novitt, Miss Eunice Pavia, and 
Miss Ruth Reamer, and to many other students in psychology classes from 1939 to 1942 


for assistance in securing data for this study, and to the National Youth Administration 
for clerical assistance. 
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tionnaires filled out was 335, from which 258 were suited for use in one 
or more of our contrasting groups of leaders and non-leaders. 

Assignment to these contrasting groups was based upon data provided 
on the supplementary question sheet. Portions of this sheet which are 
relevant to the present report are reproduced below. 


Interest-Attitude Study 


The purpose of these questions is to make a survey of certain interests and 
attitudes of men in various occupations. You need not give your name, but 
please answer all the questions. 

Do not talk over the questions in the yellow folder with anyone before 
answering them. It is better to proceed rapidly through the list of questions 
on the yellow sheet, although there is no time limit. Most persons finish the 
Inventory in 25 minutes or less. 


Age (Check group in which your age falls) 26-35........ , 36—45........ , 46 or more........ 
Occupation (¢.g. Dentist, Engineer, Farmer).................-.....--------.---ccceeeceeeeceeeeeeeeees 
Years of Experience in Occupation........................ Just what do you do? 

Are any persons under your direction or supervision?......................... If so, 


estimate the number. 





Name offices you have held since the age of 21 in any organizations: professional, 
business, civic, religious, fraternal, or social. 


Less than 5 More than 5 
Type of Organization Office Held = ago years ago 
(Check in appropriate column.) 


Estimate the number of such organizations of which you have been a member 


Ef ith Re Hoan 


From this information it was possible to pick out two kinds of leaders, 
whom we have designated as Supervisors and as Office-Holders. Super- 
visors are defined as persons who estimated that they had fifteen or more 
persons under their direction or supervision, supposedly in an executive 
capacity. They are contrasted with Non-Supervisors, who reported not 
more than one person under their supervision. In making this classifica- 
tion, we took into consideration the occupation as well as the number 
reported. For instance, when a clergyman reported 800 persons under 
his supervision, or a teacher estimated 100, we assumed that these were 
probably congregation and students respectively, and did not count such 
cases either as Supervisors or as Non-Supervisors. Office-Holders are 
defined as persons who report at least two presidencies or apparently 
important chairmanships held since the age of 21 in business, professional, 
civic, religious, fraternal, or social organizations. They are contrasted 
with Non-Office-Holders, who report no offices held. 
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The occupational distribution of our subjects is shown in Table 1, 
along with the distribution of employed adult males in New Jersey ac- 
cording to the 1940 census (9). This table is presented merely by way of 
describing the composition of our groups, and is not meant to imply that 
our groups should have shown the same distribution as the census figures. 


Table 1 


Occupational Distribution of the Sampling Used in the Present Study Compared 
with 1940 Distribution of Employed Adult Males in New Jersey 








Percen Percentages 
of a aa in the an 
Occupational Group Males in N, J. Study 
Professional 5.9 30.2 
Semi-professional 1.6 3.1 
Farmers and Farm Managers 1.8 4.7 
Proprietors, Managers, and 
Officials, except Farm 11.5 26.0 
Clerical, Sales 17.3 23.2 
Craftsmen, Foremen 19.4 7.0 
Operatives 22.2 3.1 
Domestic Service 0.4 vaae 
Service, except Domestic 7.5 2.7 
Farm Laborers (paid) and 
Farm Foremen 1.7 
Farm Laborers (unpaid family workers) 0.3 
Laborers, except Farm 9.6 
Occupation not reported 1.0 





Our distribution is the sort that might be expected from our method of 
securing subjects. Our study claims validity only for the two types of 
leadership defined by our contrasting groups, and for our sort of popula- 
tion sample. 

The age distribution of our subjects is given in Table 2. This also is 
the sort of distribution that might be expected. The final column in 
Table 2 is not a summation of the preceding four columns, since there is 


Table 2 
Age Distribution of Subjects 








Non- Office- Non-Office- 

Age Group Supervisors Supervisors Holders Holders All Subjects 
26-35 9 53 7 48 85 
36-45 24 9 11 20 49 
46- 57 26 39 48 124 


All Ages 
Combined 90 88 57 116 258 
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some overlapping among these, as indicated in Table 3. Table 3 may be 
read as follows: Of the 90 Supervisors, 21 are found among the 57 Office- 
Holders, and 26 among the 116 Non-Office-Holders. Of the 88 Non- 
Supervisors, 7 are found among the the 57 Office-Holders, and 36 among 
the 116 Non-Office-Holders. The remainder of the Supervisors and Non- 


Table 3 


Overlapping of Supervisor and Non-Supervisor Groups with 
Office-Holder and Non-Office-Holder Groups 





57 Office-Holders 116 Non-Office-Holders 





90 Supervisors 21 26 
88 Non-Supervisors 7 36 





Supervisors, of course, occupy an intermediate position. If read in the 
other direction and transmuted into percentage terms, Table 3 would 
state: Of the 57 Office-Holders, 37 per cent are found among the 90 
Supervisors, and 12 per cent among the 88 Non-Supervisors. Of the 116 
Non-Office-Holders, 22 per cent are found among the 90 Supervisors and 
31 per cent among the 88 Non-Supervisors. 


Results and Discussion 


Tables 4, 5, and 6 present comparisons involving Office-Holders and 
Non-Office-Holders. The data include the four Bernreuter scales desig- 
nated as Neurotic Tendency (B1-N), Self-Sufficiency (B2-S), Introversion- 
Extroversion (B3-I), and Dominance-Submission (B4-D) (2), and the 
two Flanagan scales (derived from the Bernreuter by factor analysis) 
which purport to measure Self-Confidence (F1-C) and Sociability (F2-S) 
(3). In reading these tables one needs to keep in mind that persons who 
score high on the Bernreuter scales are neurotic, self-sufficient, intro- 
verted, and dominant, as the abbreviated designations suggest. The 
Flanagan scales, on the contrary, are named in reverse, and those who 
score low on them are self-confident and sociable. 

Bearing these facts in mind, we find in Table 4 that Office-Holders are 
reliably more dominant, more self-confident, less neurotic, and less intro- 
verted than Non-Office-Holders. There is some evidence that Office- 
Holders are more sociable than Non-Office-Holders. In self-sufficiency 
there is no significant difference between the two groups. Table 5, com- 
paring Office-Holders with the norms for adult men, tells almost the same 
story about the characteristics of Office-Holders. Table 6, comparing 
Non-Office-Holders with the norms, shows no reliable difference in neuro- 
tic tendency, introversion, or dominance, and a possibility that Non- 
Office-Holders may be more self-sufficient, less sociable, and less self- 
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Table 4 
Comparison of Office-Holders with Non-Office-Holders 
Mean Mean Non- Mean 
Office-Holders Office-Holders Difference 
Trait N = 57 N = 116 O-—NO SE diff. CR 
B1-N — 109.2 — 67.3 —41.9 10.72 —3.91 
B2-S 45.4 46.7 —1.3 7.80 —0.18 
B3-I —52.9 —28.2 —24.7 6.48 —3.81 
B4-D 95.0 63.6 31.4 8.51 3.69 
F1-C — 83.2 — 36.9 —46.3 11.67 —3.97 
F2-8 —5.9 11.9 —17.8 7.62 — 2.33 
Table 5 
Comparison of Office-Holders with Norms for Adult Men 
Mean 
Mean Mean Difference 
Trait Office-Holders Norms O — Norms SE diff. CR 
BI1-N — 109.2 — 63.9 —45.3 9.44 — 4.80 
B2-S 45.4 32.3 13.1 6.97 1.87 
B3-I — 52.9 — 28.4 — 24.5 7.09 —3.45 
B4-D 95.0 53.9 41.1 7.51 5.47 
F1-C — 83.2 — 53.4 —29.8 9.54 —3.13 
F2-S —5.9 0.2 —6.1 6.28 —0.97 
Table 6 
Comparison of Non-Office-Holders with Norms for Adult Men 
Mean 
Mean Non- Mean Difference 
Trait Office-Holders Norms NO — Norms SE diff. CR 
B1-N — 67.3 — 63.9 —3.4 8.21 —0.42 
B2-S 46.7 32.3 14.4 5.34 2.70 
B3-I —28.2 —28.4 0.2 6.56 0.03 
B4-D 63.6 53.9 9.7 6.14 1.58 
F1-C — 36.9 — 53.4 16.5 7.72 2.14 
F2-8 11.9 0.2 11.7 5.04 2.32 





confident than men in general. These results are in substantial agree- 
ment with those obtained from our earlier study comparing college under- 
They also are in 


graduate office-holders with non-office-holders (6). 


harmony with common-sense expectations with regard to the characteris- 
tics of these contrasting groups, and thus attest to the validity of the 
scales, especially where reliable differences are found. 

Comparisons involving Supervisors and Non-Supervisors are pre- 
sented in Tables 7, 8, and 9, and are in fair accordance with a priori ex- 





=) 























pectations. 


cut. 
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The leadership personality pattern which appears here is, in 
general, not inconsistent with that shown in Table 4, but it is less clear- 


All the reliable critical ratios of Table 4 have been lowered here, 


though one may still say with considerable assurance that the leaders are 
more dominant and confident and less neurotic than the nonleaders. 


The case for introversion is much less certain. 


An interesting reversal 


(which may, however, be a matter of chance and sampling) is found in 


Table 7 


Comparison of Supervisors with Non-Supervisors 


























Mean Mean Non- Mean 
Supervisors Supervisors Difference 
Trait = 90 N = 88 S— NS SE diff. CR 
B1-N —95.1 —61.8 —33.3 11.32 —2.94 
B2-S 53.2 39.1 14.1 7.42 1.90 
B3-I —41.3 —27.4 —13.9 6.60 —2.11 
B4-D 83.6 61.2 22.4 8.19 2.72 
F1-C —70.3 —30.1 — 40.2 11.55 —3.48 
F2-S 12.4 2.2 10.2 7.49 1.37 
Table 8 
Comparison of Supervisors with Norms for Adult Men 
Mean 
Mean Mean Difference 
Trait Supervisors Norms S — Norms SE diff. CR 
B1-N —95.1 — 63.9 —31.2 8.67 —3.60 
B2-S 53.2 32.3 20.9 5.61 3.73 
B3-I —41.3 — 28.4 —12.9 6.60 — 1.96 
B4-D 83.6 53.9 29.7 6.43 4.61 
F1-C —70.3 — 53.4 — 16.9 8.13 — 2.08 
F2-S 12.4 0.2 12.2 4.85 2.52 
Table 9 
Comparison of Non-Supervisors with Norms for Adult Men 
Mean 
Mean Non- Mean Difference 
Trait Supervisors Norms NS — Norms SE diff. CR 
BI1I-N —61.8 — 63.9 2.1 9.74 0.21 
B2-8 39.1 32.3 6.8 6.31 1.08 
B3-I —27.4 — 28.4 1.0 7.18 0.14 
B4-D 61.2 53.9 7.3 6.88 1.07 
F1-C —30.1 — 53.4 23.3 9.05 2.57 
F2-8 2.2 0.2 2.0 6.27 0.31 
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F2-S. Whereas leaders of the Office-Holder type tend to be more sociable 
than Non-Office-Holders, Supervisors seem (unreliably, to be sure) to be 
less sociable than Non-Supervisors. A similar reversal, likewise unre- 
liable, from Table 4 to Table 7 occurs in B2-S. These tendencies for 
Supervisors to be self-sufficient and non-sociable are further borne out in 
Table 8, where Supervisors are compared with adult norms. Table 8, 
without disagreeing with other tables, leaves room for some uncertainty 
about the status of Supervisors in introversion and self-confidence, while 
giving reliable evidence for their low neurotic tendency and high domi- 
nance. In view of the high correlations of neurotic tendency with intro- 
version (.95) and with self-confidence (.95), this difference in critical ratios 
is rather surprising. Table 9 shows no reliable differences between Non- 
Supervisors and adult norms, though there is a fair amount of evidence 
that Non-Supervisors are lacking in self-confidence. Our findings with 
regard to dominance are in agreement with data reported by Ruggles 
and Allport (7) from the A-S Reaction Study, which measures Ascendance- 
Submission and was the initial basis for validating B4-D (2). Factory 
foremen, store managers, city executives, and factory executives showed 
definitely ascendant scores, while the scores of factory technicians, floor- 
men, and water-meter readers were close to the dividing line between 
ascendance and submission. 

Since the mean age for our leader groups is evidently greater than that 
for our non-leaders, we considered the possible contribution of age to the 
personality differences which appeared. Using F1-C as a test case, we 
compared means for leader and non-leader groups made up solely of 
individuals aged 46 or over. The results areshownin Table 10. Though 
the critical ratios are lower than those in Tables 4 and 7, owing to the 
smaller number of cases, the mean differences do not diverge significantly 
from those for the entire groups. It is true enough that there are age 
differences when high school or college students are compared with adults, 
so that separate norms are needed for these age groups. Our test with 
respect to F1-C, however, is supplemented by data reported by Miles (5). 
From tests of a population of about 550 men and women of average and 
superior ability he found that the four Bernreuter traits are independent 
of age in adults. 

A further question which calls for consideration is the status of our 21 
subjects who are classified as Office-Holders and Supervisors at the same 
time, in comparison with the status of the 36 who carry the double classi- 
fication of Non-Office-Holders and Non-Supervisors. (See Table 3.) ? 


1 Chi-square with respect to the association between our two kinds of leadership was 
computed from a three-by-three contingency table in which Table 3 was supplemented 
by the intermediate groups. A central intermediate group was composed of the 77 cases 
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Tabie 11 presents the results for these groups. When the means for those 
who combine the two types of leadership are compared with the separate 
means for Office- Holders and Supervisors in Tables 4 and 7, it is evident 
that those who are leaders on both counts are not thereby endowed with 
a greater degree of the dominance, self-confidence, extroversion, and 
freedom from neurotic tendency which characterize both groups of leaders 


Table 10 
Comparison of Contrasting Groups of Subjects over 46 Years of Age on Scale F1-C 











Mean Mean Non- Mean 
Office-Holders Office-Holders Difference 
N = 39 N = 48 O-—-NO SE diff. CR 
— 80.6 —43.8 — 36.8 16.80 — 2.20 
Supervisors Non-Supervisors 
N = 57 N = 26 S8-—NS 
— 66.0 — 24.2 —41.8 21.93 —1.91 
Table 11 


Comparison of Leaders Who are Both Office-Holders and Supervisors with Non-Leaders 
Who are Both Non-Office-Holders and Non-Supervisors 








Mean Mean Mean 
Leaders Non-Leaders Difference 
Trait N = 21 N = 36 L—NL SE diff. CR 
BI1-N —91.7 — 54.4 — 37.3 20.06 — 1.86 
B2-S 42.6 38.3 4.3 12.01 0.36 
B3-I —47.9 — 22.8 — 25.1 11.88 —2.11 
B4-D 83.1 58.3 24.8 14.71 1.68 
F1-C — 63.6 —14.4 — 49.2 22.01 — 2.23 
F2-S —1.7 10.0 —11.7 11.88 —0.98 





when considered separately. Those who are doubly classed as non- 
leaders, however, give some suggestion of having less of these four traits 
than either one of the separate non-leader groups. The critical ratios in 
Table 11 tend to be smaller than those in Tables 4 and 7 chiefly because 
of the smaller number of cases. Where the trends in Tables 4 and 7 are 
in agreement, in the four traits mentioned above, Table 11 shows trends 
in the same direction. Where the trends in Tables 4 and 7 are in opposite 
directions, in B2-S and F2-S, Table 11 seems to present a compromise. 


which were left over from our 335 questionnaires after selection of the 258 which could 
be classified in our contrasting groups. A p value of 0.10 was found, indicating only a 
slight possibility of more than a chance association between the two kinds of leadership, 
but an association that is in the positive direction. 
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Summary and Conclusions 


Out of 335 adult males aged 26 and above, 258 cases were classifiable 
in contrasting groups representing two types of leaders and non-leaders. 
There are 90 Supervisors, 88 Non-Supervisors, 57 Office-Holders, and 116 
Non-Office Holders. The contrasting groups in each pair are compared 
with each other and with adult norms with respect to mean scores in the 
six scales of the Bernreuter Personality Inventory. 

Office-Holders are found to be reliably less neurotic, less introverted, 
more dominant, and more self-confident than Non-Office-Holders or than 
the norms for adult men. Supervisors are significantly less neurotic and 
more self-confident than Non-Supervisors, and less neurotic, more self- 
sufficient, and more dominant than the norms. In respect to the other 
traits named above as characteristic of Office-Holders, Supervisors show 
trends in the same direction but lower critical ratios. In sociability, 
Office-Holders and Supervisors show opposite trends, of relatively low 
significance. 

The scale for neurotic tendency, despite its high correlation with the 
introversion-extroversion scale, shows a more significant difference be- 
tween our contrasting groups, especially in the comparison of Supervisors 
with Non-Supervisors. This is also true when comparing our two leader- 
ship groups with the norms for adult men. 

The mean age for the leader groups is greater than that for the non- 
leaders, but evidence is presented to show that the score differences are 
not due to age differences. 

Persons with the dual classification of Supervisors and Office-Holders 
fail to show a greater degree of the traits associated with leadership 
than that found in either total group considered separately. Those who 
are Non-Leaders in both of these classifications, however, give some evi- 
dence of being extra short in leadership traits. 

The results of the present study are in substantial agreement with 
those of an earlier study in the same series, in which college undergraduate 
office-holders were compared with non-office-holders. 


Received August 29, 1943. 
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A 3 By 3 Analysis of the Predictive Value of Test Scores 


W. C. Krathwohl 
Illinois Institute of Technology 


Educational tests are frequently used in an attempt to predict achieve- 
ment in academic subjects. The method usually used is to compute a 
correlation coefficient between test scores and course grades and from this 
to find the equations of the lines of regression. Unfortunately, in educa- 
tional measurements there are so many variables that the coefficient of 
correlation frequently is too low for satisfactory use. The usual values 
of r are in the neighborhood of 0.50 to 0.60 and only rarely get as high as 
0.70. Since for some purposes such low values of r are unsatisfactory, 
other methods have been devised which give useful results. 

The method which we are using at the Illinois Institute of Technology 
is what we call a3 by 3 analysis. In this analysis, test scores and achieve- 
ment grades are each divided into three groups and each group of test 
scores is compared with each group of achievement grades. This makes a 
total of nine groups which are investigated. The data are then in a form 
which yields a great deal of interesting and valuable information. 

The three groups are formed by dividing the test scores by means of 
the percentile ranks. Scores less than the 25th percentile constitute the 
poor group; scores between and including the 25th to the 75th percentile 
constitute the average group; and scores greater than the 75th percentile 
constitute the good group. This division corresponds to the one usually 
used in educational measurements where the middle 50 per cent of a group 
are classified as normal or average. 

It is not necessary to use percentile ranks to separate the educational 
test scores. The same effect can be accomplished if derived scores are 
used which have a mean of 20 and a standard deviation of 4. In this 
case the poor group consists of students having derived scores less than 
18, the average group from 18 through 22, and the good group has scores 
greater than 22. If Scaled Scores are used, where the mean is 50 and the 
standard deviation is 10, the dividing points are approximately 44 and 56. 

The achievement grades likewise are divided into three groups, low, 
average and honor grades. We use the letter grades A, B, C, D and E 
where D and E are classified as low grades, C as the average grade and A 
and B as honor grades. 


318 











8 by 3 Analysis of Predictive Value of Test Scores 319 


An illustration showing how this is accomplished is given in the accom- 
panying Table 1, where grades in a freshman Social Science course are 
compared with the local percentile ranks of the American Council on 
Education Psychological Examination, Form 1941. The first column 
contains those scores on the Psychological Examination which have a 
local percentile rank below 25. The second column contains those scores 
which have a percentile rank from 25 through 75 and the third column 
contains scores whose percentile rank is greater than 75. The fourth 
column gives the number of grades awarded in each row. 


Table 1 
A Typical 3 by 3 Analysis 
Percentiles A.C.E. Psychological Examination 





Less than 25 


25 through 75 


More than 75 
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The first row contains the honor grades of A and B, the second row the 
average grade of C and the third row the low grades of D and E. The 
fourth row gives the number of students classified as poor, average and 
good. 

As a matter of convenience the cells in this table will be designated 
by a pair of numbers of which the first figure gives the number of the row, 
and the second figure the number of the column. Thus (2, 3) means the 
cell in the second row and the third column. 

Within each of these cells the figure at the left is the number of 
students who have the characteristics of that cell. Thus in cell (1, 2) 
there are 30 students who received honor grades and who had an average 
test score on the Psychological Examination. Also within each of the 
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cells, the figure in the upper right hand corner over the arrow pointing to 
the right gives the percentage of students in that row who have the test 
scores within the grouping designated at the top of the column. Thus 
in the first row, which gives the honor grades for the Social Science course, 
4 per cent of the students were classified as poor on the Psychological 
Examination, 42 per cent as average and 54 per cent as good. The figure 
in the lower right hand corner of each cell over the arrow pointing down 
gives the percentage of students in that column who achieve grades within 
the grouping at the left of the row. Thus in the first column, which 
contains the students who made low scores in the ACE Psychological 
Examination, 4 per cent received honor grades, 27 per cent the average 
grade of C and 69 per cent low grades. 

The fourth row and the fourth column are in the nature of summaries. 
The fourth row summarizes the information on the test and the fourth 
column that of the criterion. Thus, the fourth row gives the information 
that in the entire class of 298 students, 24 per cent were rated by the Psy- 
chological Examination as poor, 51 per cent as average and 25 per cent as 
good. The fourth column gives the information that in the entire class, 
24 per cent of the grades awarded were honor grades, 36 per cent were 
average and 40 per cent were low grades. 

Much interesting and valuable information such as the following can 
be drawn by analyzing the individual cells. 

1. If the Psychological Examination predicts grades in this Social 
Science course, then poor students should not get honor grades. Hence 
cell (1,1) should beempty. The fact that it contains three students leads 
to the questions: (a) Does the test measure the course? While a categori- 
cal, yes, cannot be given, the dichotomy established by the nine cells 
seems to indicate that the test is at least a fair measuring instrument. 
(b) Did these three students do themselves justice on the Psychological 
Examination? This can be answered if a sufficiently large battery of tests 
has been given or if it is known that when the students took the test, they 
were in satisfactory physical or mental condition and were highly motiv- 
ated. (c) Are there members on the teaching staff who are inclined to be 
easy markers? 

2. Since high scoring students should not get poor grades, cell (3, 3) 
should be empty. The fact that it contains seven students leads to the 
questions: (a) Why are these students not working up to capacity? The 
variables involved are probably the usual ones such as personality malad- 
justments, physical disabilities, financial troubles and poor study habits. 
By means of a good counseling system or a similar organization, these 
conditions can be investigated and followed up to give a student real help 
with his troubles. (6b) Are there members on the teaching staff who are 
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erratic markers? (c) How capable is the teaching staff? (d) Does the 
course challenge the exceptional student? (e) Are individual sections too 
arge for one instructor to handle? 

3. Column 4 with 24 per cent honor grades, 36 per cent average grades 
of C, but 40 per cent low grades has a poor distribution. The cause of 
this aberration lies in the second column, where more average ability 
students received low grades than received the average grade of C. Nor- 
mally it is expected that a group of average ability students should get 
more C grades than low grades. At the same time in a class of this size, 
the total number, 108, of C grades should be greater than the total num- 
ber, 118, of low grades. This raises some of the questions previously 
discussed, but it also raises two other questions: (a) Are the admission 
requirements too lax for the standards maintained by the faculty of the 
institution? If the grading is fair and equitable, possibly there are 
students in this freshman class who never should have been admitted. 
(b) Do the students have a negative attitude toward the course? In this 
particular instance some of them undoubtedly do, since young engineering 
students frequently have an idea that only engineering courses are worth 
while. An attitude of this type challenges the best of teachers. 

4. The percentages in the fourth row of 24 per cent, 51 per cent and 
25 per cent are what one would expect since practically the entire class 
took the course and the percentiles on which these categories were based 
also were determined from the entire class. These percentages, however, 
in an elective instead of a prescribed course are of extraordinary value by 
indicating the type of student which the course attracts. For instance, an 
easy course will attract poor students, whereas a difficult course is more 
likely to appeal to the better students. 

5. The probability that a student will receive a certain type of grade 
also can be predicted from this table. For instance, if he is rated as a 
poor student on the Psychological Examination, his chances of getting 
an honor grade in Social Science are 4 per cent (cell 1, 1), or 4 chances out 
of 100, whereas his chances of securing a low grade are 69 per cent (cell 
3, 1), or 69 out of 100. On the other hand if he is in the group of good 
students, his chances of getting an honor grade is 51 per cent (cell 1, 3), or 
51 out of 100, but he still may get a low grade, since his chances for that 
are 9 per cent (cell 3, 1) or 9 out of 100. 

Facts of this kind are often useful in counseling students. They show 
the poor student that his case is not always hopeless, providing he is will- 
ing to work hard enough. On the other hand, they show the good student 
that brightness alone is not sufficient to pass a course. He must be on 
his guard if he wishes to achieve results commensurate with his ability. 








W. C. Krathwohl 


Summary 


A 3 by 3 analysis, where educational test scores are compared with 
achievement grades, can give valuable information even though the coeffi- 
cient of correlation between test scores and achievement grades is low or 
unknown. Some of the information thus obtained can be used to counsel 
students and to indicate weaknesses in faculty grading, student attitudes 
and administration policies. 


Received August 25, 19438. 








Prognostic and Other Values of Daily Tests 


F. C. Sumner and Nettie M. Brooker 
Howard University 


For the past five years daily testing on the accumulated material of 
the course has been in operation in sections of General Psychology taught 
by Dr. Sumner. The tests used are of the objective matching type and 
contain on the average 25 items in Column B. They are constructed a 
week ahead and mimeographed on legal size paper, two tests to a sheet. 
The course runs two terms and is designated Psychology 101 and 102, the 
first term being devoted to the behavioristic approach and the second term 
to the introspective. In all, 80 tests are given during the two terms of 
the course, 40 toeach term. The term mark of the student is his average 
for the 40 tests. The last 15 minutes of the class hour is devoted to the 
daily test. This daily testing is begun about 2 to 3 weeks after the open- 
ing of the term. 

From the study of complete records of the first 200 students in Psy- 
chology 101 it is now possible to draw definite conclusions as to the prog- 
nostic value of this daily testing. 


Prognostic Value of the Daily Tests 

It is a question whether prediction of the student’s success or failure 
can be reliably made by means of daily tests. Such prediction, if possible, 
would obviously be of greater guidance-value the nearer the beginning of 
the course it can be made. In the present study of the prognostic value 
of the daily tests it is a matter of ascertaining whether reliable predictions 
can be made from the averages for the first 5 tests as to the averages for 
the 40 tests. 

In Table 1 is presented a scatter-diagram of the relation between the 
averages of the 200 students obtained from the first 5 tests and their term 
averages obtained from 40 tests. 

The Pearson product-moment correlation coefficient is .82 + .0156. 
The mean of the averages for the first 5 tests is 70.8 per cent while the 
mean of the averages for the 40 tests is 74.4 per cent. The difference 
between these two means is statistically significant, the critical ratio 
being 3.13. The sigma of the averages for the first 5 tests is 13.2 while 
the sigma of the averages for the 40 tests is 9.6. 

These statistical measures indicate: 1. The standing of the students 
relative to one another at the end of the first 5 tests will be approximately 
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the same as their standing relative to one another at the end of the 40 
tests; 2. The mean of the group for the 40 tests will be 100 chances out of 
100 higher than the group mean for the first 5 tests; 3. The spread of the 
individual averages for the 40 tests will be less extensive than the spread 


Table 1 


Scatter Diagram Showing the Relation Between Averages for the First 5 Tests and 
Averages for the 40 Tests 





z (averages for 40 tests) 
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70 3 8 15 5 31 
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45 2 2 
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35 1 1 
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of the individual averages for the first 5 tests with the result that initially 
high averages are ultimately lowered somewhat while initially low aver- 
ages are ultimately raised. 

In a study by the present authors entitled, “Variability of Students’ 
Marks Earned in Daily Tests,” which appeared in The Journal of Psy- 
chology, 1943, 15, it was found that the low-grade student exhibits a 
greater tendency to variability in his marks than does the high-grade 
student. 

The present study sheds further light on the difference between the 
low-grade and high-grade student. Correlating the 114 averages for the 
first 4 tests which were 70 per cent or above with the term averages of 
these same students for 40 tests, one obtains an r equalling .60. Corre- 
lating the 86 averages for the first 5 tests which were below 70 per cent 
with the term averages of these same students for 40 tests, one obtains 
an r equalling .68. In other words the relative standings of students 
whose averages for the first 5 tests were below 70 per cent will remain 
more nearly the same for the 40 tests than the relative standings of stu- 
dents whose averages for the first 5 tests were above 70 per cent. 
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The means of the 86 students whose averages were below 70 per cent 
for the first 5 tests were 58.5 per cent for the first 5 tests and 67 per cent 
for the 40 tests. The means of the 114 students whose averages were 
70 per cent and above for the first 5 tests were 80.2 per cent for the first 
5 tests and 85.0 per cent for the 40 tests. In other words both low-grade 
and high-grade students on the average do better on 40 tests than on the 
first 5 tests but the low-grade students do much better in terms of gain 
in group mean than do the high-grade students. 

Returning to the group of 200 cases and comparing their averages for 
the first 5 tests with their averages for the 40 tests as to the percentages of 
term averages which are lower, equal or higher than the original averages 
for the first 5 tests, we see in Table 2 something of the chances in 100 of a 


student’s term mark being lower, equal or higher than his average for the 
first 5 tests. 








Table 2 
Number of Averages for Percentage of Term Averages (40 Tests) 
Cases First 5 Tests Lower Equal Higher 
12 90— 67% 33% 0% 
37 80— 32 62 5 
65 70— 8 66 26 
44 60— 0 34 66 
31 50— 0 23 77 
7 40— 0 29 71 
4 30-— 0 0 100 





Students making an average in the 90’s on the first 5 tests will most 
likely make lower than 90 per cent for the 40 tests although 33 chances 
in 100 they equal their initial averages; those making an average in the 
80’s and 70’s on the first 5 tests will most likely make similar averages for 
the 40 tests; those making averages below 70 per cent on the first 5 tests 
will most likely make higher than their initial averages for the 40 tests. 

Presenting the data on which Table 2 is based in a more serviceable 
form i.e. in terms of letter grades, we see in Table 3 something of the 
chances in 100 of a student’s term mark being A, B, C, D, E or F, once his 
mark for the first 5 tests isknown. Table 3 gives ready answer to a ques- 
tion so frequently put to a teacher particularly by the student of initial 
low-standing. 

Students making A for the first 5 tests will make B for a term average 
67 times out of 100 but in no instance will they make a term mark lower 
than B; 62 times out of 100, initial B students will make B for a term mark 
but in no instance will they make a term mark lower than C; 66 times out 
of 100, initial C students will make C for a term mark but in no instance 
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will they make a term mark of A or one lower than D; 57 times out of 100, 
initial D students will make a term mark of C but in no instance will they 
make a term mark of A or one lower than D; 52 times out of 100, initial 
E students will make a term mark of D but in no instance will they make 
a term mark higher than C or one below E; in no instance will initial F 











Table 3 
Number Percentage of Term Marks (Based on 40 Tests) 
of Cases Marks for First 5 Tests F E D Cc B A 
12 A 9- 0% 0% 0% 0% 67% 33% 
37 B 80- 0 0 0 32 62 5 
65 C 7- 0 0 8 66 26 0 
44 D 60- 0 0 34 57 9 0 
31 E 50- 0 23 52 26 0 0 
7 F 40- 29 57 14 0 0 0 
4 F 30— 50 0 50 0 0 0 





students make a term mark above D. It is obvious that here we are 
dealing with probabilities and not with possibilities. It would be statis- 
tically possible for a student making zero average for the first 5 tests to 
obtain nearly an A term-average. Such a feat, however, is high'y im- 
probable. 

It may be that one prefers, instead of ready reference charts as exem- 
plified above, regression equation technique for predicting the most likely 
term mark which a specific student will make, once his average for the 
first 5 tests is known. For that, the correlation coefficient, the means and 
sigmas of the respective distributions as obtained from Table 1 or from 
one of similar derivation are necessary. 

Apparently the prognostic value of daily tests is more reliable than 
the prognostic value of general intelligence test-results. Intelligence 
ratings correlate with scholastic grades usually from .40 to .50. The 
highest sample correlation coefficient obtained by the present authors 
between intelligence ratings and the term averages for the 40 tests was 
.51 while the lowest obtained was .00. The averages for the first 5 tests 
are fair samples of the students’ actual performance i.e. of their specific 
aptitude and correlate, as we have seen, .82 with term marks based on 
40 tests. Actual achievement embraces special intelligence, motivation, 
study-habits, speed-habits, previously acquired content and to some extent 
learning-increment in the present situation. 


Overlearning Value of Daily Tests 


The learning-increment evidenced in the rise from a group average of 
70.8 per cent for the first 5 tests to a group average of 74.4 per cent for 
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the 40 tests may be attributed in part to overlearning. While a crucial 
test which would isolate this overlearning effect from other possible 
factors was not instituted, it is a fact that the daily testing of accumulated 
materials of the course did provide an overlearning situation as against 
the laissez-faire underlearning situation which usually prevails where stu- 
dents are subject only to occasional check. The daily tests constructed 
in such a way as to rake over the entire past content of the course afford 
more repetitions of the material than just sufficient for a first errorless 
reproduction. These daily tests also necessitate on the part of the stu- 
dents daily reviews outside of class and are followed by frequent discus- 
sions of test items and a comparison of notes after class. Advantageously 
coupled with this repeated imprinting is the role of the daily test-items 
as goal ideas which enhance the vividness of the imprinting by directing 
attention to facts and their relations otherwise dimly perceived. The 
students who at the outset were averse to the regimen of daily tests re- 
quiring daily preparation and daily attendance become subsequently con- 
vinced of its learning value and spontaneously admit that they had never 
learned a subject so thoroughly before. 


The Motivative Value of Daily Tests 


In the absence of a direct. measurement of the motivative value of the 
daily testing, it must suffice to mention certain conditions and evidences 
of enthusiasm on the part of the students who are being subjected to this 
regimen. 

The scored tests are returned to the students each day at the beginning 
of the hour and the key is placed on the blackboard. At the end of each 
10 tests the averages of the students for the 10 tests just completed are 
read to the class. The students thus know at all times their own standing 
and at stated intervals the standing of those about whom they may be 
concerned. Thus they are motivated to rival their own scores and to 
keep up with or to surpass their fellow-students. Also the students are 
able to keep themselves posted everyday on the weak spots in their 
knowledge-fund. 

There is a noticeable increase in the number of low-grade students 
dropping the course after a week or so of tests. This fact may skew 
slightly the curves of distribution of marks utilized in this study since 
only cases having complete records for the term have been employed. 
The voluntary withdrawals on the part of low-score students are the 
result of discouragement as readily admitted by the individuals concerned 
and indicate a certain educational self-guidance value of daily testing. 

There is manifested an eagerness on the part of the students to receive 
their scored papers. Considerable elation is shown over self-gratifying 
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scores and also there is much comparison of papers. In defenses made 
for the correctness of their answers marked wrong there is evidenced 
something more than bickering namely a conscientious desire to learn 
and to be understood. 

Learning-morale is further evidenced in greater attention to the lec- 
ture, in ready cooperation in the test-situation, in the absence of cheating 
save in a case or so of pathological character, and in conspicuous engross- 
ment with one’s test-paper. Spirited discussions of the test-items in the 
hallways after the test are daily occurrences. 


Summary 


1. Daily tests of an objective matching type afford an early oppor- 
tunity to predict term-marks of students and to counsel in the light of 
these predictions. 

2. Daily tests make for overlearning through frequency and vividness 
of imprinting. 

3. Daily tests provide conditions for enhancing the learning-morale 
through knowledge of results, self-rivalry and a lodging of responsibility 
for marks squarely upon the shoulders of the student. 


Received August 21, 1943. 
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Performance of Mental Defectives on the Revised Stanford- 
Binet and the Kent E-G-Y Tests 


Arthur L. Rautman 
Public Schools, Sioux City, Iowa 


The Kent Oral Emergency Test has found considerable application in 
psychological clinics, especially in situations necessitating a quick pre- 
liminary mental evaluation of an individual. It has found favor with 
social and welfare workers handling cases of delinquency and other social 
problems. Considerable use has also been made of this test as a measure 
of general ability in the preliminary grouping of patients which is neces- 
sary upon their arrival at various institutions, before a more complete 
and adequate classification can be made. The chief advantages claimed 
for the Kent E-G-Y Test are that it takes less than ten minutes to ad- 
minister; it requires no special equipment; and, since it calls for informa- 
tion of a constant and general nature, it can often be given to the examinee 
without arousing the antagonism which sometimes develops when a more 
formal test is employed in emergency situations. 

The test itself (5) consists of twenty-five questions arranged in five 


separate groups to make three overlapping scales of three question groups 
each: 


Points 
Group I Credit 
1. What are houses made of? (Any materials you can think of)..... 1-4 
Fee I ls avin ie wih b suede ees Waewdeesones es 1-5 
eee 1-3 
Nee nce ence ec achedeunateses secces 1, 2,4 
5. If the flag floats to the south, from what direction is the wind?..... 
Group II 
8. is de WUMINNe wwidony a0 K's 1 
ee en ces Suc nccacesscchossvcsseces 1-2 
ie en IS, Us eect eee cee tees sees 1-2 
NN PEE Ee 1-2 
10. What does ice become when it melts?......................... 1 
Group III 
11. How many minutes in an hour?....................0. 0.0 eee 1 
SES ne 1-3 
13. Why is it colder at night than in the daytime?................. 1-3 
Bs, en OW WP IE OU IND I, ck ecw cis pec necens 1-4 
15. Now the names of some fishes......................... 000000: 1-4 
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Group IV 


16. At what time of day is your shadow shortest? 
17. Give the names of some large cities 
18. What is paper made of? 
19. How many stripes in the flag? 
20. Whose picture is on a two-cent stamp? 
Group V 


21. What is the difference between a cable and a chain? 

22. Why does the moon look larger than the stars? 

23. What metal is attracted by a magnet? 

24. What is electricity used for? 

25. If your shadow points to the northeast, where is the sun? 


Several studies of the Kent E-G-Y Test, in which the results secured 
from this test are compared with the scores obtained from various other 
psychometric examinations, have been published. These studies report 
coefficients of correlation between the Kent and the Binet examination 
which are in the neighborhood of .84 to .88 (1, 2, 4, 9). Lewinski (7) 
compared the results obtained from the Kent E-G-Y Test and from the 
verbal battery of the Bellevue-Wechsler Adult Intelligence Scale and 
reports a coefficient of correlation of .73 between these two tests. MclIn- 
tire and Hoffeditz (8) studied the test results of 161 retarded children on 
the Kent E-G-Y Test and the old Stanford-Binet examination and found 
a coefficient of correlation of .87 between the mental ages of their subjects 
on these two tests. In general, children of low intelligence tend to make 
higher scores on the Kent Test than on the Binet. 

The present study is a comparison of test data obtained from the 
Kent Oral Emergency Test and from the Revised Stanford-Binet exam- 
ination. We were primarily interested in the relationship existing be- 
tween the scores secured on these two tests by a group of mentally retarded 
pupils. An analysis of the individual questions of the Kent examination 
was also made in order to determine the relative discriminative value of 
the various individual test items. 


Comparison of Kent and Binet Data 


The Kent E-G-Y Test was given as an informal preliminary interview 
immediately preceding the more formal Revised Stanford-Binet psycho- 
metric examination, Form L. All of the examinations were administered 
by the author. In scoring the Kent E-G-Y Test responses, the directions 
given in the original test monograph (5) were rigidly followed. The 
mental ages were calculated according to the method described by Tea- 
garden (10). In determining the Kent IQ, the mental age was treated 
exactly as the mental ages found on the Stanford-Binet Scale, and the 
1Q’s were found from the tables included in the Terman and Merrill Test 





Performance of Mental Defectives 331 


Manual (11). The Kent E-G-Y Test consists of three scales; each scale, 
in turn, is composed of three groups of questions. Scale A, consisting 
of question groups I, II, and III (i.e., Questions 1 through 15), was given 
first. Scale B (i.e., question groups I, III, and IV) and Scale C (i.e., 
question groups I, IV, and V) were given if it appeared probable that the 
patient was able to score on these more difficult scales. The MA and 
IQ as used in this study are based upon that scale on which the patient 
was able to score the highest IQ. 

both the Kent E-G-Y Test and the Revised Stanford-Binet Scale, 
Form L, were given to 350 mentally retarded patients at the Northern 
Wisconsin Colony and Training School. Only subjects having an IQ of 
less than 80 on the Revized Stanford-Binet Scale are included in this 
study. In life age, the group ranged from 5 to 71 years, with a mean CA 
of 22.4 years, sigma 10.9 years. 


Table 1 


1Q’s and MA’s of 350 Mentally Retarded Patients on the Kent E-G-Y Test and the 
Stanford-Binet, Form L 





Range Mean Sigma 





Kent MA 5-1 to 13-6 8.61 years 2.04 years 
Binet MA 3-0 to 11-6 7.19 years 1.98 years 


Kent IQ 33-106 60.84 13.68 
Binet IQ 24— 79 50.76 13.14 





Table 1 shows that the mean MA for the total group was 1.42 years 
higher on the Kent E-G-Y Test than on the Stanford-Binet. The coeffi- 
cient of correlation between these Kent and Binet mental ages is .81, 
+.01. 

A comparison of the mean IQ’s secured on these two examinations 
shows a difference of 10.08 IQ points higher in the case of the Kent 
examination (Table 1). The coefficient of correlation between the in- 
telligence quotients earned on these two tests is .84 + .01. 

This r of .84 between the IQ’s secured on these two tests does not 
describe completely the relationship existing between these two examina- 
tions. A better understanding of this relationship may be gained from 
Table 2 in which these differences are presented in tabular form. 

From Table 2 it can be seen that, in the present study, the Kent IQ 
exceeded the Binet IQ in 88 per cent of the cases. This tendency appears 
to be a characteristic of the test whenever it is employed with individuals 
of low intelligence, and, therefore, in work with such groups, allowance 
for this rather consistent deviation must be made. If this is done with 
the present data and a mean difference of 10 IQ points is allowed for, 
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49.4 per cent of the scores fall within 5 points above or below the Binet IQ 
and 84 per cent fall within a range of 10 IQ points. 


Item Validation 


In order to determine the diagnostic value of the individual questions 
of the Kent examination, an analysis of each question was made. The 
test records of the examinees to whom the tests had been given were 
grouped, on the basis of their Stanford-Binet MA’s, into two groups. All 


Table 2 
Difference in IQ (Kent minus Stanford-Binet) 








Difference in IQ Frequency Per Cent Total Per Cent 
(—6)-(— 10) 6 1.7 8.6 
(—1)-(- 5) 24 6.9 : 

0 12 3.4 3.4 
1- 5 65 18.6 
6-10 79 22.6 

11-15 83 23.7 88.0 
16-20 52 14.8 
21+ 29 8.3 





individuals having a MA of 7 years or above were classified as belonging 
in the High group and all individuals having a MA of less than 7 years 
were considered as belonging to the Low group. The Chi-square values 
were then calculated to determine the degree to which the test item en- 
ables us to discriminate between the High and the Low mental age groups, 
by means of the formula for 2 X n fold tables given by Goulden (3, 


page 96): 
= Tr Az (1) - 8} 


In order to demonstrate the consistency of the results, two groups of 
data were secured by a chance-half division of the original test records. 
These two groups are called the “Even” and the “Odd” groups. For 
both of these groups the separate Chi-square values were determined for 
each test item. 

The Odd and the Even groups were also compared directly by means 
of the Chi-square analysis. The resulting values of P range from 0.905 
to 0.094, but all of them are within the range of statistical consistency. 
In no case was there a statistically significant difference between the Odd 
and the Even groups. 
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Table 3 
Item Analysis of Kent E-G-Y Test Based on Two Groups of “High” and “‘Low”’ 
Scorers on the Stanford-Binet Test 











Degrees Chi-squares 
Item of 
No. Freedom Odd** Even** Total 
1 3 44.14 55.27 97.19 
2 3 61.77 56.35 116.00 
3 2 60.20 52.67 112.46 
4 2 44.75 33.37 76.59 
5 1 4.24* 44.83 38.63 
6 1 1.16* 1.64* 2.56* 
7 2 7.26* 11.26 18.00 
8 1 0.85* 0.88* 1.74* 
9 2 31.19 32.92 62.78 
10 1 16.71 7.22 22.87 
11 1 44.91 53.40 98.23 
12 3 50.68 56.74 106.16 
13 2 53.93 54.76 107.93 
14 4 41.26 66.19 105.77 
15 ‘ 46.62 49.60 95.08 
16 1 0.65* 12.27 8.74 
17 4 25.67 7.46* 32.72 
18 2 12.13 5.84* 16.84 
19 1 7.84 20.02 26.47 
20 1 0.39* 0.14* 0.15* 
21 2 3.75* 4.86* 7.19* 
22 1 2.51* 1.92* 4.41* 
23 2 0.15* 2.82* 2.01* 
24 3 11.83 0.45* 3.90* 
25 1 1.11* 3.35* 4.16* 





* Non-differentiating test item (P value greater than 0.01). 
** “Odd” and “Even” refer to the two sets of data resulting from the chance-half 
division of the original test records. 


The values of Chi-square for the Odd group, for the Even group, and 
for the Total group are presented in tabular form in Table 3. From this 
table it can be seen that not all of the questions differentiate between the 
various levels of mental retardation to a like degree. All test items found 
to be non-differentiating (that is, those having a P value greater than 
0.01) are clearly marked on the table. 

Question number 6, Where do fishes live?, has little discriminative 
value for our group. The value of P for the Total group on this test 
shows that there are about 11 chances in 100 that a Chi-square of 2.56 
could have occurred. by pure chance. 
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Question number 8, What is the color of grass?, also has little or no 
discriminative value for a group of mentally retarded subjects, since 
there are 19 chances in 100 that the difference between the High and the 
Low mental age groups could have been obtained by chance alone. 

The test items of Group III appear to be superior to those of Group II, 
with the one exception of question number 20, Whose picture is on a two- 
cent stamp? For this item a Chi-square of 0.15 and a P value of 0.70 
show no discrimination. 

Apparently the test items in Group V, comprising questions number 
21 through number 25, are too difficult to have any discriminative value 
in the examination of individuals of low mentality. 


Summary 


The Kent E-G-Y Test and the Revised Stanford-Binet psychometric 
examination, Form L, were given to 350 mentally retarded patients with 
an IQ (on the Stanford-Binet Scale) of less than 80 at a state institution 
for the feebleminded. The scores on the Kent Test were approximately 
ten IQ points higher than the scores on the Binet examination, the coeffi- 
cient of correlation between the IQ’s being .84 + .01. If this mean dif- 
ference is taken into consideration, approximately 50 per cent of the Kent 
1Q’s come within 5 IQ points of the Binet score, and 84 per cent come 
within 10 points of the Binet score. 

A Chi-square analysis of the individual questions of the Kent E-G-Y 
Test brings out the fact that several items have very little discriminative 
value, and apparently they do not enable us to distinguish between the 
upper and lower levels of intelligence included in this study. Questions 
number 6, 8, and 20 seem to be particularly unsatisfactory. The test 
items included in Group V are apparently too difficult to have any dis- 
criminative value for low intelligence groups. 

If the difference in IQ’s found in this study is taken into consideration, 
the Kent E-G-Y Test should prove an invaluable aid in clinical and extra- 
clinical situations in which a brief and simple, but fairly accurate, test 
of mental ability is desired. This test furnishes us with much useful data 
when used as an orientation interview preparatory to the administration 
of the more formal Stanford-Binet examination. It should find applica- 
tion in institutions for the mentally retarded or in other institutions in 
which staff physicians are often called upon to make a preliminary psy- 
chometric estimate. The Kent examination is also recommended for 
social workers and public health nurses, as well as for others who may 
find such a preliminary classification helpful in determining whether or 
not an individual should be referred to a psychological clinic for a more 
thorough psychometric evaluation. 


Received March 20, 1948. 
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II. Stroke-width, Form and Horizontal Spacing of Numerals 
as Determinants of the Threshold of Recognition * 


Curt Berger 
Cornell University 


B. Night-Experiments " 

1. Recognizability of White Numerals with Reflected Light and Luminous 
Numerals during Night-Conditions. First, the optimal light-intensities 
for white numbers of optimal day vision under night-conditions were 
determined, using 5, 10 and 15 watt lamps as light-sources for reflecting 
light. The exact location of the light-source was as generally used in 
Denmark, in the center, some inches below and before the illuminated 
license-plate. Ten to 15 Watt-lamps were found practically equal and 
better than 5 Watt. A further increase of light-intensities did not seem 
to improve recognizability further. 

Similar experiments were made with luminous numbers of equal ap- 
pearance, cut out of card-board and illuminated from behind, the light- 
source being in a light-tight box. Ten Watt lamps were found m. + 
satisfactory. 

These experiments were made only in order to determine roughly the 
optimal average light-intensities for reflected as well as luminous num- 
erals under the above described night-conditions. Actually the experi- 
ments described in this paragraph should have been made in combination 
with these preliminary experiments, since probably each particular in- 
tensity used will show a maximum recognizability with one particular 
width of stroke, changing into a slightly more slender stroke when in- 
tensity increases, if reflected light is used. In the case of luminous 
numerals such changes are probably limited to a very narrow range of 
extremely slender stroke-widths in combination with relatively very great 
changes of intensities which are not practicable. Such a thorough in- 


* Continued from June issue, J. appl. Psychol., 1944, 28, 208-231.. 

16 The Danish as well as many other license-plates are lighted from below during the 
night, and this light-source is also used partly for the red rear-light. Experiments have 
shown that the use of this red rear-light so close to the number diminishes its legibility 
between 10 per cent to 20 per cent. It must therefore be recommended that the red 
rear-light be used as far away from the number-plates as possible. New motorcar models 
already have the red rear-light on one or both outer sides of the rear and the license-plate 
alone in the middle of the rear. In that case the red rear-light does not affect the 
legibility of the numerals on the licence-plate any more. 
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vestigation would have been a task of considerable proportions. Never- 
theless, it would have been carried out but for two reasons. 

First, if reflected light is used under night-conditions, the numerals 
were bound to have the width of 6 mm., namely the optimal daylight 
structure, since it is more or less practically impossible to use on the same 
plate two differently constructed numbers for day-vision and night- 
vision, both with reflected light. 

Second, the intensities used should be kept low because of practical 
reasons; that is that the lamps are run from motorcar batteries. Further- 
more, it could be concluded from preceding experimental results of a 
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Fig. 11. Dependency of the threshold of recognition upon stroke-width of numerals 
during night-conditions (Partly dark-adapted, compare text, p. 11). Curve A = lumi- 
nous numerals, Curve B = white numerals with reflected light. 


theoretical nature, that using night-conditions under which the human 
eye, partly or totally dark-adapted, has greatly increased light-sensitivity, 
intensities would rather have to be decreased than increased in order to 
obtain better recognizability. The lower the intensities, the less aberra- 
tion and the fewer glaring effects at night. The main improvement was 
to be expected from investigating differences between reflected light- 
conditions and luminous numerals, illuminated from behind. The pre- 
liminary study of optimal light-intensities was therefore limited to the 
above described rough determination of optimal average light-intensities. 

Subsequently, experiments were made with the number 8 and the 
number 2, using widths of strokes between 2 and 10 mm. for numerals 
with reflected light, and widths of strokes between 1 and 5 mm. for 
luminous numerals. The results are shown in Tables 5 and 6 and the 
average of all these experiments in the curves of Figure 11. 
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The very slender numerals with a width of stroke of 1 to 2 mm., illuminated 
from behind (luminous), are on an average (5 subjects used) 10 per cent to 
18 per cent more recognizable at the above mentioned intensity than the white 
numerals of optimal stroke-width with reflected, optimal illumination. Fur- 
thermore, the wider the stroke of luminous numerals (beyond 2 mm.), the 
less recognizability was obtained, while with numerals using reflected 
light, the recognizability increases with the width of the strokes until a 
maximum is reached between 6 and 8 mm., under the above described 
illumination-conditions decreasing again with wider strokes. 

In Table 7 results are compared directly between luminous five- 
number groups with only 2 mm. stroke-width, the old Danish numerals 
with reflected light and optimally legible white numerals of 6 mm. stroke- 


Table 7 


Comparison of Threshold Recognition between 2 Five-Number Groups during 
Night-Conditions. The Danish Numbers as Used before the War, the New Daylight 
Numbers with Reflected Light (15 Watt) and Luminous Numbers with a Stroke-Width 
of 1.5 mm., Illuminated from behind with 4 x 10-40 Watt. 4 Observers were used. 











Luminous Numbers 
New Improvement 
Numbers 
with in 
Danish Reflected Luminous in m. cent 
Ob- Number Number, Light, Numbers, (com with 
server Group m. m. m. Danish num.) 
Gi. 80.236 25.3 29.4 34.7 9.4 37.6 
91.475 24.0 30.5 35.8 11.8 49.1 
Schoe 80.236 26.5 29.7 35.3 8.8 32.6 
91.475 25.3 32.4 34.0 8.7 34.8 
Scha 80.236 21.6 23.8 28.2 6.6 30.0 
91.475 22.8 26.4 30.0 7.2 31.3 
Ma. 80.236 23.7 26.2 34.2 10.5 43.7 
91.475 24.1 26.8 33.2 9.1 37.9 





width and with reflected light. The luminous slender numerals are on 
an average about 37.1 per cent more recognizable than the Danish and 
about 17.8 per cent more recognizable than the optimal white numerals of 
6 mm. stroke-width with reflected light. 


Discussion of the Results 


The results obtained in this investigation are interesting in several 

esp ects. 
First, the previously mentioned work of K. Dunlap” can be thor- 
jue ly analyzed. Since it is the only exhaustive experimental study of 


17K. Dunlap, Op. cit., 1932. 
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the legibility of numerals on license-plates known to the author, it seems 
worth while to draw clear conclusions from this study with respect to 
Dunlap’s statements: 

(a) Light background with dark numbers gave best results. The validity 
of this general statement is due and limited to the particular structure of 
the numbers, light on a dark background, and dark on a light background 
compared. As a generalization it is definitely wrong. The actual com- 
parison should be made between optimally recognizable white numbers 
(relatively slender) and optimally recognizable black numbers (with a 
wider stroke). Any other comparison is a chance comparison and will 
depend upon the fixed absolute proportions between stroke-width and 
breadth and height of the numerals chosen. If the comparison is made 
between optimally recognizable white and black numerals, it has been 
shown above that the white numerals on a black background are about 
8.8 per cent more recognizable than the black on white, if used singly. 
The question becomes somewhat more complicated, if five-number 
groups are used. It is probable that black numerals will require 
smaller “‘inner’’ and ‘‘outer” distances for adjustment to standard than 
the white numerals. But since the stroke-width for black numerals, 
optimally recognizable, is so much larger than for white numerals, it is 
doubtful how much the loss of recognizability for the single numbers can 
be compensated by less spacing between them or inside them. As long 
as the height of the numerals and the “‘standard” area are kept constant, 
it is probable that the optimum recognizability obtainable for black 
numerals by adjusting their inner and outer distances might be close to 
equality to optimally recognizable white numbers, but not more. 

(b) Plates without borders seem best. This problem, as described above, 
depends largely upon two factors: whether black numerals on a white 
backbround are used or vice versa, and upon the width of the borders and 
their spacing away from the top and bottom as well as the sides of the 
numerals, if white numbers are used. Contrary to Dunlap’s statement, 
our above described experiments show that making a white frame of a 
width equal to the numeral-stroke-width and spacing it at the correct 
distance increases the legibility of white numerals considerably. Whether 
a similar effect is exercised by a particular size of the white background 
or a black border (contrast) for black numerals, has to be decided by 
further experiments. 

(c) Numerals spaced further apart gave highest legibility. It is true 
that at present most numerals are spaced too close together. Thus, 
Dunlap found those numerals more legible which were spaced farther 
apart. Nevertheless, as shown above, there is no reason to make the 
spacing between the numbers larger than necessary. It should corre- 
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spond to the recognizability of the single and standard number, which 
can be found by the procedure described above, and which is different 
for a five-number group than for two numbers alone. If the space 
between the numbers is larger than that corresponding to standard, a 
further increase cannot possibly give “higher” recognizability, because 
the numbers themselves are already illegible at a distance from the eye, 
in which the numerals would fuse into each other. It also would enlarge 
the license-plates unduly. Dunlap’s statement thus is true only until a 
definite limit is reached. 

(d) Plates in which the numbers did not exceed 25 per cent of the total 
area of plate were most efficient. This is not correct for white numerals, 








Fic. 12. Final appearance of all numbers, luminous on a black background for night- 
vision, reduced to 4% grd of the original area. (Compare tables 5 and 6.) 


where the background and its size has no influence upon the recognizabil- 
ity of the numerals, being black. But even if we consider as “total area”’ 
of the plate for white numerals the area covered or surrounded by the 
white frame, the white numbers, found in this investigation as optimal, 
cover about half of that area. It is also doubtful whether this statement 
is correct for optimally constructed numbers, even if they are black. 
Nevertheless, in the case of a white or colored background, its size might 
have a particular “surrounding” effect, which has to be investigated for 
each case separately. 

(e) Numerals with slender stroke were more efficient. It is true that in 
most cases, actually used in practice, the strokes are too wide. But there 
is a definite limit to the slenderness of the strokes, both for white numbers 
on a black background, and particularly for black numerals on a white 
background with daylight. It is different for both cases, but if the 
numerals are chosen more slender than corresponding to optimal standard 
recognizability, the legibility will diminish rapidly as shown in Figure 2. 
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Fie. 13. Comparative representation of the “norm’’ number 8 and a letter H, and 
the same symbols, constructed on Snellen’s principle. (Note that inner distance (D) of 
letter H is not adjusted to standard.) 

343 








344 Curt Berger 


Besides our wide amplification of Dunlap’s results, it is a notable dis- 
covery, made up on the basis of previous theoretical work, that recog- 
nizability depends upon form as well as upon character and color, black, 
white, luminous and so on of the numbers used, and not exclusively upon 
the equality of “details” as assumed by Snellen and others. The differ- 
ence between the results obtained in this investigation and Snellen’s 
principle is shown in Figure 13 for white numerals with daylight. Two 
particularly important conclusions can be drawn from this discovery: (1) 
Since the underlying theory was based upon experiments made under a 
| moderate degree of light-adaptation, while for our night-conditions partly 
dark-adapted observers were used, visual resolution of luminous details 
for the partly dark-adapted eye might not differ basically from resolution 
of the moderately light-adapted fovea. (2) If we take the “inner dis- 
tances’’ of the numerals required for standard recognizability, as the basis 
for an estimation of the “goodness” of their forms with daylight, they 
range as follows (starting with the best), 2, 0, 7, 3, 5,6,4and8. The 
zero, closest to the circle, is not the best, while the first three are less 
structured than the following three numerals, which again are simpler 
than the numerals 4and8. Thus it can be concluded, that the more com- 
plicated the structure of a numeral, of equal stroke-width and under other- 
wise constant conditions, the more difficult is its recognizability. Neither 
Gestalt-assumptions '* nor the work of Helson and Fehrer '* are supported 
by our results. Form plays a definite role for the recognizability of nu- 
merals, but its effect must rather be explained by structural and functional 
properties of the retina or a corresponding organization of central parts 
of the nervous system. The angles formed by connecting lines between 
horizontal or vertical end-points which are optimal for the recognizability 
of the forms, seem to be independent of configuration, showing the same 
tendency for all numerals. These results lead to the conclusion that the 
recognizability of numerals is, in spite of its being a very complex function 
even under the simplest life conditions, directly related to the size as well 
as the function of the structural basis of the human eye, namely the single 
functional units of the retina.?° 

Finally, we must mention a point of view which, though not predict- 
able, opens up an interesting perspective. The numerals, presented as 
final results for daylight in this study (Fig. 10), have been developed 
exclusively on the basis of optimal recognizability, using the psycho- 
physiological method of thresholds. But they seem also to possess high 
esthetic quality. Although the appearance of the numerals when near 





18 Koffka, K. Op. cit., 1932. 
1° Helson, H., and E. V. Fehrer. Op. cit., 1932. 
2° Berger, C., and F. Buchthal. ‘Op. cit., 1938. 
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at hand is not directly comparable to their appearance near threshold- 
distance, there may be a relation between recognizability and esthetic 
quality. Symbols of optimal recognizability may prove, under definite 
conditions, to be the symbols of highest esthetical appeal under the same 
conditions, even when regarded at shorter distances than the threshold. 
The proof of this assumption must, however, be undertaken in a separate 
investigation. If found correct, the structure and properties of the re- 
ceptive visual organ, particularly of the retina, might prove not only, as 
recently suggested by Polyak,” to be the real basis of the a priori qualities 
of space (Kant), but also for the esthetic qualities of seen objects. Our 
experiments indicate that the solution of this problem is complicated by 
a very great number of factors in ordinary vision. It has to be specifically 
approached for each particular situation, but a solution might be obtained 
for certain definite conditions. Our results suggest that the properties, 
structural and functional, of the human retina offer a more direct way of 
approaching this problem than do the configurational theories. 


Summary 


1. A method and procedure is described to investigate the influence 
of stroke-width of white and black numerals, specific form-factors, dis- 
tances between the strokes of numerals, distances between two numerals 
and surroundings upon the threshold of recognition, with a view towards 
improvement of the recognizability of the numerals. The same method is 
applied to conditions of night-vision of medium dark-adaptation. 

2. A construction is found for 9 numerals, white on black background, 
luminous during night-conditions, which are optimally recognizable 
(standard area-42 mm. X 80 mm.) and which at the same time are ad- 
justed to standard in such a way, that each single numeral as well as two 
and five-number constellations appear or disappear at the same distance 
from the eye, a distance which is the greatest possible distance for the 
particular area chosen. 

3. During the investigation the following results were registered: 

(a) Numerals, white on a black background, have an optimal average 
recognizability, if their stroke-width is 6 mm. on an area 42 mm. X 80 
mm. Numerals, black on a white background, have an optimal average 
recognizability, if their stroke-width is 10 mm. on an equal area. The 
proportion of this stroke-width to the inner horizontal distances of the 
numbers is in the first case about 1 : 5, in the second about 1: 2.2. The 
white numerals are under these conditions, singly, about 8.2 per cent more 

*1 Woodsworth, R.S. Experimental psychology. New York: H. Holt & Co., 1938, 
368-392. 
* Polyak,S. L. The retina. The University of Chicago Press, 1941, 444-446. 
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recognizable than the optimally constructed black numerals for the same 
area. 

(b) Investigating many detailed characteristics of form, it was found 
that the angle under which two horizontal lines are connected (or two 
vertical lines) has a particular importance for the recognition of a numeral. 
The recognizability is best with angles which cut the adjacent parts of 
the area into two equal halves. A vertical or horizontal connection is 
least recognizable. 

(c) A five-number group requires about 10 per cent more space 
between the numerals than 2 numbers alone, even though the space 
between the two numerals already has been adjusted to standard. 

(d) A white frame around white numerals improves their legibility 
only if at a certain distance from the top and base of the numerals, and 
only if its width is equal to the stroke-width of the numerals. Then the 
improvement is about 9 per cent. 

(c) Under ordinary night-conditions (medium dark adaptation) very 
slender, luminous numerals at threshold brightness are about 17.8 per 
cent more recognizable than optimally constructed white numerals with 
reflected light. 

(f) The relations of these results to previous theoretical work are dis- 
cussed, and it is pointed out that they not only corroborate theoretical 
conclusions concerning structural as well as functional concepts of the 
human eye, particularly its fovea, but may also lead to interrelations 
between purely physiological and certain esthetic aspects of human vision. 


Received April 26, 1943. 











Job Specifications in Applied Psychology 


Note: The editor will be glad to receive job descriptions and specifications in 
the fields of applied psychology. These will be published from time to time to 
provide information for students, applied psychologists, employers, and em- 
ployment agencies. 


Vocational Counselors * 


The occupational description which follows was prepared as a guide 
' for establishing appropriate training programs for vocational counselors. 
The description covers a family of counseling positions. It was felt 
advisable to prepare a composite description rather than attempt to 
write up each one separately. 

While this description has been prepared and reviewed by members of 
the Commission, it is not to be considered as the official description of any 
one governmental agency or other organization. The counseling task in 
each situation varies according to the function of the employing establish- 
ment and according to the breakdown of positions within the organization. 
In one situation the counselor may perform nearly all of the duties listed 
in the description; in another situation, and most frequently, the coun- 
selor may specialize in one or more phases of the occupation. It is felt, 
however, that prospective counselors should receive training in all phases 
of the occupation in order that he or she may be equipped to accept em- 
ployment in any of a number of situations. Furthermore, the counselor 
with broad training can more readily transfer from one counseling task to 
another and similarly such counselors will have the proper training for 
possible promotion into positions which require considerable background. 

-The number of vocational counselors which will be required in the 
conversion and post-war periods is not known. It is believed, however, 
that several thousand additional persons will be employed in various types 
of vocational counseling by rehabilitation, placement, educational and 
social agencies throughout the country. It is not known how many 
persons now in the armed forces who have had counseling training will fill 
these positions, nor is it known what proportion of these positions will be 

* This job description was prepared by Captain B. L. Canaga, Major Spencer D. 
Benbow, Miss Elizabeth Cosgrove, Mr. Ira D. Scott, Mr. Michael J. Shortley, and Dr. 
C. L. Shartle, Chairman, Committee on Classification and Job Specification of Vocational 
Counselors, War Manpower Commission, Division of Training. Director Ernest J. 
Jaqua, Bureau of Training, has kindly permitted the Journal of Applied Psychology to 
reprint the report which appears in a bulletin issued by the War Manpower Commission. 
See News and Notes section for brief note on the report of the Committee on Training. 
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filled by persons now in similar or related civilian war work. It is known, 
however, that the total demand for counselors will exceed the number now 
trained. 

The added counseling load is already beginning to develop. Its peak 
and duration will depend upon events in the war and upon the intensity 
and extent of economic adjustments after the war. 


Occupational Description for Vocational Counselors 
Work Performed 
1. Obtains and collates information about the individual. 

a. Secures written information from the counselee in advance of the 
personal interview, whenever possible, or in a personal interview 
secures information about the individual’s education, employment, 
military experience, vocational training, and physical limitations. 

b. In a personal interview obtains information about the individual’s 
hobbies, special interests, personality traits and attitudes. When- 
ever advisable to do so also obtains information about financial 
status, social background, family or personal responsibilities. 

c. Obtains pertinent records such as those from schools, previous em- 
ployers and military services. 

d. Administers appropriate aptitude, interest, personality, trade and 
scholastic achievement tests to the individual counselee and pre- 
pares the scores for such tests. 

2. Obtains occupational, educational, and other information. 

a. Visits places of employment and obtains information by occupation 
on present and future employment possibilities, including informa- 
tion on duties, qualifications, length and type of training necessary, 
wages, hours, working conditions and physical demands. 

b. Examines available published education information, visits schools, 
colleges, training centers, vocational training establishments and 
obtains information on training opportunities, including courses 
offered, cost, entrance requirements, schedules, and the like. 

c. Visits agencies performing various types of community services to 
which counselees may be referred; keeps currently informed regard- 
ing services rendered. 

d. Keeps abreast of occupational, educational, and industrial trends, 
national and local, and of new techniques, information and data for 
counseling. ; 


3. Weighs and interprets all secured information and evaluates the indi- 
vidual’s potentialities in terms of probable educational and occupational 
adjustment. 





4, 


5. 
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Assists the counselee in making and carrying out educational and occu- 
pational plans. 


a. Helps the individual to estimate his own potentialities in relation 


to existing occupational and educational alternatives. 


b. Reviews and discusses with the counselee educational and occupa- 


tional opportunities which are in keeping with his work history, 
training, aptitudes and interests, and with any personal or other 
limitations, such as financial, physical, or social, which would tend 
to prevent the counselee from taking advantage of certain oppor- 
tunities. 


c. Assists the counselee in arriving at plans. 


(1) for immediate employment and/or training 
(2) for long-range objectives including professional training. 


d. Arranges for referral to employers or to community agencies, such 


as training, employment, health, legal, recreational, social, financial, 
educational, vocational rehabilitation, or others cooperating in the 
execution of plans. 


Follows progress of counselee during training program and subsequent 
placement, and assists him in meeting adjustment problems. 


Basic Qualifications 


1. 


2. 


Must have well-rounded, up-to-date knowledge of industrial and 
occupational trends and labor market conditions. 

Must be experienced in the use of occupational materials developed 
for use in vocational counseling, such as systematized occupational 
information including occupational classifications, job descriptions, 
definitions, job families and the like, as well as the interviewing aids 
and other working devices and materials. 

Must be able to develop and prepare for use local occupational and 
training information, including data on working conditions as well as 
on duties and qualifications. 


. Must possess personal characteristics and skills to interview and 


maintain continuing counseling relationships in which the cooperation 
and confidence of the counselee are obtained, and in which pertinent 
facts and attitudes are discovered and related to a workable plan. 
Must have the ability to observe personal characteristics in the inter- 
view and interpret them in terms of their significance in occupational 
adjustment. 

Must have a sound background in the nature of human skills, abilities, 
interests and aptitudes and in scientific methods of measuring and 
appraising them. 
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6. Must have a knowledge of the functions and services of community 
facilities such as placement, rehabilitation, social, health, legal and 
recreational services. Must be able to develop and maintain effective 
working relationships with representatives of such facilities. 

7. Must be able to recognize various types of physical and mental dis- 
abilities and, wherever indicated, be able to make referral for special 
service to agencies qualified to render such service. 

8. Must have a working knowledge of Federal, state and local laws and 
regulations affecting employment and training, including special pro- 
visions such as workmen’s compensation, child labor laws, and laws 
pertaining to the employment of women. 

9. Must be able to develop, maintain and use systematic case records 
or case studies of counselees. 

10. Must be able to carry responsibilities in an organization, to work 
under supervision, to give supervision if necessary and otherwise 
adjust to the duties of the particular position as assigned. 








News and Notes 


As a fitting climax, celebrating ten years of occupational research 
initiated by Dr.'W. H. Stead and Dr. M. R. Trabue, the staff of the Divi- 
sion of Occupational Analysis and Manning Tables of the War Manpower 
Commission, headed by Dr. Carroll L. Shartle and Dr. Beatrice J. Dvorak, 
describe the scope of the program and accomplishments in ten chapters 
in the April, 1944 issue of Occupations, The Vocational Guidance Magazine. 
These chapters cover the extensive program of job analysis; naming, 
defining, and classifying jobs; defining and classifying ‘‘entry”’ fields of 
work; job families; physical demands of jobs; job descriptions; trade tests 
and trade questions; occupational aptitude tests; and future trends in 
occupational research. 





Dr. Morris S. Viteles, Chairman of the Committee on Selection and 
Training of Aircraft Pilots of the National Research Council, submits the 
following information in regard to research on aviation psychology: 
Facilities for research in the selection, training, and maintenance of pilots 
have recently been expanded by the organization of an Institute of Avia- 
tion Psychology at the University of Tennessee. It will be administered 
by the Committee on Selection and Training of Aircraft Pilots of the 
National Research Council in cooperation with a special Project Commit- 
tee of the University of Tennessee and the Division of Research, Civil 
Aeronautics Administration. 

‘The Institute of Aviation Psychology, the first in the United States— 
and possibly in the world—represents a major development in a program 
of research on the human factor in aviation initiated in 1939 by the Civil 
Aeronautics Administration in setting up its plans for training a large 
number of civilian pilots. 

At the time of Pearl Harbor, there had already been accumulated in 
this research program a mass of data and numerous practical methods 
which were immediately made available to the Armed Services for use in 
building up a competent force of aviation personnel. During the past 
three years, the emphasis in research has been on the selection and train- 
ing of military pilots. The establishment of an Institute of Aviation 
Psychology at a state university, supported by state as well as federal 
funds, represents a method of assuring the continuation of such research 
in the post-war era with a renewed emphasis upon the problems of civliian 
flying. 
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Special attention is to be given to problems of training and to develop- 
ing methods of instruction and training aids which can help to reduce 
) failures among student pilots and to decrease the incidence of accidents 
| following the completion of training. The United States has pioneered in 
) such research in work done at various universities under the general ‘ 
supervision of an Executive Subcommittee of the National Research 
Council Committee on Selection and Training of Aircraft Pilots consisting 
of: Charles W. Bray, Dean R. Brimhall, Cdr. Daniel J. Brimm, Leonard 
A. Carmichael, Lt. Cdr. Jack W. Dunlap, Lt. Col. John C. Flanagan, 
Harry M. Johnson, Walter R. Miles, G. R. Wendt, and Morris 8. Viteles, 
Chairman. 

In the proposed studies at the University of Tennessee, there will be 
available findings and apparatus which make possible an accelerated 
program of research and training. Student pilots will be drawn from | 
civilian residents of Knoxville and its vicinity who will be trained on a 
University airport. Fellowships for training will be available for qualified | 
candidates. 





Dr. Edgar A. Schuler, Senior Social Scientist in the U. 8S. Department 
of Agriculture, reports that a significant training and testing program is 
being developed in cooperation with Dr. Charles P. Loomis of the Office 
of Foreign Agricultural Relations. The following is a brief description of 
the project: 


“In connection with the Department of Agriculture project on essential 
non-competitive agricultural products about one hundred forty trainees, repre- 
senting all the countries of Central and South America, will be brought to the 
United States to spend a year of study and training. These trainees will be 
exposed to different types of experience depending upon the branch of Agricul- 
ture with which they will be working: Soil Conservation Service, Agricultural 
Extension Service, or the Bureau of Agricultural Economics. 

“In order to determine the influence of this period of training upon the 
knowledge, attitudes and opinions of the trainees a testing program has been 
devised. This program includes the following: vocabulary tests, both standard 
forms and innovations which attempt to measure aural comprehension and 
understanding of popular language phrases; an information test, which empha- 
sizes knowledge in the field of international economic relationships, but also 
includes general American cultural information; tests of opinions and attitudes 
regarding inter-cultural differences; the collection of data regarding the sources 
of the trainees’ knowledge about American culture. These tests will be re- 

ted at the end of the training period in order to measure intervening changes. 

he objective tests will be supplemented by informal interviews throughout the 
period of training.” 





Under the direction of Dr. Ernest J. Jaqua, Bureau of Training, War 
Manpower Commission, an Advisory Commission on Vocational Counsel- ; 
ing has been studying the need for trained vocational counselors for 


: 
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demobilized soldiers and sailors and displaced war workers. From in- 
formation made available to the Commission, many thousands of coun- 
selors will be needed for the next several years. 

Dr. E. G. Williamson, Chairman of the Committee on Training, re- 
ports that a topical outline of the content of graduate courses required 
for training counselors has been completed and published in a bulletin 
issued by the War Manpower Commission. The committee organized 
its report in two sections, first the long-term, full technical training to be 
offered at the graduate level and, secondly, the short-term, informal 
training courses in institutions for those who have some relevant pro- 
fessional background and for others who will serve as community volun- 
teer workers supplementary to professionally trained counselors. 

The major areas of professional training draw heavily from certain 
fields of psychology and from business administration. Each of the 
“units of training” is organized in terms of major and minor specific topics 
to be covered by instructors with particular emphasis upon application of 
knowledge from several disciplines to the tasks of the vocational counselor. 
Selected bibliographies should prove suggestive for the organizing of these 
courses, specifically designed for the training of counselors. It is ex- 
pected that many adaptations can and should be made of existing courses 
for this specific purpose. It is further expected that relatively. few uni- 
versities will have sufficient competent instructors to offer the full, well- 
rounded training sequence for professional counselors. It should be 
noted that the committee on training did not deal with the problem of 
training teachers in high schools and colleges for “faculty counseling.”’ 
The task assigned was entirely that of professional training for full-time, 
technical counselors. 

The major courses or units of training include the following: Intro- 
duction to vocational counseling; Personality adjustment; Measurement 
for vocational counseling; Rehabilitation of the handicapped; Educational 
and occupational training opportunities; Occupational information; Labor 
market analysis; Community organizations; Public personnel administra- 


tion; Techniques of vocational counseling; and Supervised counseling 
practice. 











Book Reviews 


Blankenship, Albert B. Consumer and opinion research. New York: 

Harper & Brothers, 1943. Pp. x + 238. $3.00. 

Consumer and opinion research is thorough and practical. As the sub- 
title “The Questionnaire Technique” suggests, this book covers mainly 
the mechanics of conducting field surveys with the usual type of fixed 
interview schedule. Furthermore, no attempt is made to deal with 
highly technical problems or methodological discussions that would be 
inappropriate for the readers for whom the book is intended. By limiting 
his field, Blankenship has been able to treat the area he has selected in 
very thorough fashion. No doubt these restrictions are also partly re- 
sponsible for the fact that the book is practical. 

Chapter I discusses the role of opinion polls and commercial surveys in 
wartime, presents a short historical summary of the development of 
questionnaire surveys, describes the principal types of surveys and the 
organizations which conduct them, and explains why journalism, psy- 
chology, political science, sociology, economics, market research, adver- 
tising, and statistics all are important in providing the necessary back- 
ground for conducting surveys. 

Chapter II provides a general summary of the steps in conducting a 
survey from the original statement of the problem through the prepara- 
tion of the report. It gives a thumbnail sketch of the whole process in 
preparation for the more detailed discussion of each step in Chapters 
ITI-XITI. 

In Chapter XIV, Blankenship tackles the difficult problem of discus- 
sing the adequacy of surveys. His viewpoint is realistic and most people 
with experience in this field will agree with his conclusion that each survey, 
or at least each type of survey, should be evaluated separately without 
attempting to pass judgment on the adequacy of surveys in general. 

Chapter XV analyzes the more common criticisms of survey methods 
and even includes the objections which are based upon the effects of sur- 
veys on our social system. 

Consumer and opinion research evidently was written mainly to meet 
the needs of students and business executives. For students, it gives a 
good idea of what actually happens when surveys are conducted. It is 
not intended as a “Become a Survey Expert in Ten Easy Lessons.” 
Whether this book can be used as the basic text in a course in marketing 
research, advertising research, or business psychology will depend upon 
the extent to which the basic text will be required to cover the whole field, 
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because it covers only one part of any of these fields. However, it would 
be an excellent supplementary text; it could be used as the basic text if the 
other areas were covered by other means; and a course in the use of the 
conventional questionnaire in marketing and opinion research could be 
built around the book. 

For business executives, this book gives a good idea of what to expect 
and what not to expect from surveys. It will help them in evaluating 
survey results and give them a better understanding of the problems con- 
fronting the people who conduct their surveys. 

Even research practitioners will find Blankenship’s ideas stimulating. 
Furthermore, it serves a useful purpose in assembling material from vari- 
ous sources in a field in which it is difficult to keep in touch with all devel- 
opments because the sources are so scattered. 

Blankenship’s treatment of each topic is thorough. He discusses the 
mechanics of each operation in detail. For example, eight pages are 
devoted to the problem of the sequence of questions. The topics which 
are not discussed in detail are the ones that could not be handled thor- 
oughly without going above the level of the readers for whom the book is 
intended or ranging outside the boundaries of their interests. For exam- 
ple, statistical considerations, including sampling, are kept on an ele- 
mentary level and are treated from the practical rather than the technical 
viewpoint. 

However, this is not the only reason why the book is practical. It is 
obvious the book was written by some one who has actually done the 
things he is writing about. Published studies of others are included 
whenever they are relevant but the illustrations drawn from personal 
experience and the practical viewpoint could not have been obtained from 
published material alone. One typographical error could be mentioned 
and one or two minor objections might be raised; but they are of no 
practical significance and will not be included in this review. 

Most readers will get the general impression that there is a scarcity of 
methodological research in this important field and that most methodo- 
logical questions are settled for each study on the basis of logical analysis 
and practical experience rather than on the basis of results of studies of 
fundamental methodological principles. Of course several studies have 
not been included because they do not apply to the specific field covered 
by this book. Nevertheless, for this specific field, it appears that the 
methodological research is not very extensive. What little there is has 
been valuable, and this suggests that at least some methodological funda- 
mentals can be developed if the studies are designed especially for this 
purpose. 


Alfred C. Welch 
War Production Board 
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A B C’s of scapegoating. Chicago: Central YMCA College, 1944. 72 p. 
$.25. 

Only the foreword of this pamphlet can be associated with its writer, 
Gordon W. Allport. The work is predominantly a cooperative enterprise, 
representing the contributions of the seminar in psychological problems of 
morale at Harvard University. In addition to the foreword, there are 
eight brief chapters, a postscript, and a bibliography of 27 titles. The 
main body of the pamphlet presents in a lucid, richly illustrated manner 
the following aspects of scapegoating: What is scapegoating? motives in 
scapegoating; sources of race prejudice in the child; types of scapegoaters; 
the victim of scapegoating; forms of scapegoating; dangers of scapegoating 
in wartime; and methods of combatting scapegoating. 

Since the aim of the pamphlet is to further understanding of the dan- 
gers of scapegoating to the end that constructive forces in America might 
be focused upon the reduction of the disintegrating effects of one form 
of misplaced aggression, practical rather than t!eoretical interpretations 
guide the reader. He is introduced to the origins and manifestations of 
displaced aggressions without being encumbered with the niceties of 
definition. Occasionally, the psychologically sophisticated reader will 
desire a more clear cut differentiation of psychological structures referred 
to as fear, anxiety, and discrimination, forexample. Generally, however, 
the writers have succeeded in handling complex concepts and phenomena 
in simple terms. This increases the value of the pamphlet to the layman 
since attention is constantly held upon how scapegoating is manifested and 
what consequences follow to the aggressor and to the victim. 

The wealth of illustrations of scapegoating, the simplicity with which 
fundamental assumptions are expressed, and the directness of applications 
commend this pamphlet to many readers. It should be useful to em- 
ployers and employees, to socially-minded citizens who are groping for 
dependable information concerning antagonisms toward minority groups, 
and to students enrolled in classes in beginning psychology or even in 
social psychology. Whether or not the omission of two references from 
the bibliography was an accidental oversight this reviewer cannot tell, 
but both are so clearly appropriate and important for understanding 
scapegoating better that he regrets missing them. One is Freud’s 
Civilization and its discontents and the other book, like this pamphlet a 
product of cooperative endeavor from a neighboring university—Yaie— 
is by Dollard, Doob, Miller, Mowrer, and Sears, Frustration and ag- 
gression. 

Charles Bird 


University of Minnesota 























Book Reviews 357 


Hollingworth, Harry L. Leta Stetter Hollingworth: a biography. Lincoln, 
Nebraska: University of Nebraska Press, 1943. Pp. 204. $2.75. 
One does not usually expect a high degree of objectivity in a biography 

authored by a relative or close friend of the subject, but we find here an 
exception to the rule. The author has shown a rare degree of restraint by 
substituting for his own personal evaluations the kind of factual informa- 
tion which speaks for itself. The evaluations included are nearly all 
quoted from the subject’s colleagues and former students. 

This is a psychological biography. The author’s purpose has been to 
explain the work and personality of Leta Hollingworth, in so far as this is 
possible, in terms of heredity, early environment, and developmental 
history. Extensive use is made of documentary evidence, including a 
baby diary kept by the mother, school records, and revealing examples of 
the subject’s poetic and prose compositions over many years. Special 
attention is given to factual data which indicate childhood abilities and 
the interests which foreshadow in some degree the direction and quality 
of later achievement. 

That Leta Hollingworth was an extraordinarily gifted child will be 
obvious to anyone who is familiar with the norms of development. Her 
mother’s diary covering the first year (reproduced in this volume) gives 
information regarding seven items of behavior on which norms have been 
established by child psychologists, and on all of these Leta was clearly 
precocious. A poem which she wrote at the age of fourteen compares 
favorably with the best juvenilia this reviewer has seen. She graduated 
from high school with highest grades at sixteen and from the University 
of Nebraska with Phi Beta Kappa honors close to her twentieth birthday. 

Although Leta Hollingworth was born as late as 1886, her childhood 
in western Nebraska was lived under truly pioneer conditions. She was 
born in a dug-out, moved later to a sod house, and received her elementary 
education in a one-room log schoolhouse. Her mother, who was evi- 
dently a woman of superior intelligence, died when Leta was only three 
years old. The next seven years she spent under the loving care of her 
maternal grandparents. Her grandfather was a farmer as well as a min- 
ister and Leta learned to do all the chores, indoors and out, that were 
suitable to a child of her years. When she was ten her father remarried 
and brought Leta home to an unsympathetic stepmother, with whom she 
lived unhappily and misunderstood until her graduation from high school. 
There is reason to believe that the bitter experience of these years may 
have been crucial in directing her interests later to the study of gifted 
children, who so often are thwarted and misunderstood. 

In college she majored in English and took numerous courses in the 
social sciences, including several in psychology and education. After her 
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freshman year she earned all of her expenses by reading English themes. 
Upon graduation she taught English in high schools for two years, then 
in 1908 was married to Dr. H. L. Hollingworth, a graduate student at 
Columbia who had been her classmate at the University of Nebraska. 
For several years she performed the duties of a housewife and at the same 
time carried enough work at Columbia University to enable her to take 
her master’s degree in 1913. In 1914 she received appointment as the 
first clinical psychologist of New York under a recently enacted civil 
service law. She received her Ph.D. degree at Columbia University in 
1916 and the same year was made an instructor in Teachers College. 
Leta Hollingworth was thus launched upon a career that before her 
death in 1939 had made her one of the outstanding figures in American 
psychology. 

The first hundred pages of the biography are devoted to family back- 
ground, childhood, youth, and the early adult period; the last hundred 
to the development and fruition of her interests as a teacher, writer, and 
researcher at Teachers College. Her published works include 9 books 
and some 80 articles in professional magazines. Along with her research, 
writing, and heavy load of teaching she found time to sponsor 26 disserta- 
tions between 1920 and 1939. Her life work, which enriched so many 
aspects of psychology and education, was accomplished without the aid 
of subventions and with little or no paid assistance. 

Comparable productivity by a man would probably have been re- 
warded by election to the presidency of the American Psychological Asso- 
ciation or even to membership in the National Academy of Sciences. 
This opinion of the reviewer is primarily a reflection on the voting habits 
of male psychologists. Actually the work of Leta Hollingworth did not 
lack appreciation. She won not only the respect and admiration but 
also the affection of her students, her colleagues at Columbia, and the 
innumerable psychologists and educators everywhere who knew her 
personally or through her publications. 

Probably Leta Hollingworth will be longest remembered for her studies 
of gifted children, the first of which was published in 1917 and the last 
after her death. Two of her 9 books and 37 of her 80 contributions to 
periodicals dealt with either the psychology or the education of superior 
deviates. In 1922 she began a three-year study of children above 155 IQ 
in a special opportunity class, and a parallel study of another group with 
1Q’s between 135 and 155. A continuous follow-up of these and other 
gifted subjects was carried on until her death. Her book on Gifted 
children (1926) and her posthumous volume on Children above 180 IQ were 
largely the fruits of this experiment. In 1936 an even more important 
five-year experiment in the Education of Gifted Children was undertaken 
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at the Speyer school of Teachers College, with Leta Hollingworth as 
director of curriculum research. The greater part of her spare time dur- 
ing the last three years of her life were devoted to this project and the 
fact that she did not live to complete the undertaking and to interpret 
the results for educators is regrettable beyond words. Because of her 
untimely death the great majority of her contributions on the gifted child 
have never been summarized in book form. This is something that 
should still be done. 

The picture that one gets of Leta Hollingworth from this biography is 
that of a highly gifted and versatile mentality, a charming and balanced 
personality, and utter devotion to the highest professional ideals. Among 
the 26 chapters which delineate this portrait are those entitled Childhood, 
High-School Days, College Years, Life Plans, Attitudes and Viewpoints, 
Feelings, and Emotions, An Interlude and Marriage, Clinical Psychology 
Begins, Poems Written in Adult Life, Early Research and Publications, 
At Teachers College, Courses of Instruction and Books, First Educational 
Experiment, The Special Opportunity Class (P.S. 165), At Public School 
500 (Speyer School), Interests, Personal and Home Life. 

But the story is not complete, as the author has for the most part 
excluded himself and his relations with the subject from the biography. 
Many readers will hope that he may decide to write a second volume 
devoted to the inner life of Leta Hollingworth as he himself knew it. 


Lewis M. Terman 
Stanford University 
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Books, monographs, and pamphlets for listing and possible review should be 
sent to Donald G. Paterson, Editor, Department of Psychology, 
University of Minnesota, Minneapolis 14, Minnesota 


The naval officer’s guide. Arthur A. Ageton. New York: McGraw-Hill 
Book Company, 1944. Pp. 587. $3.00. (Second edition.) 

Naval leadership and the American bluejacket. Arthur A. Ageton. New 
York: McGraw-Hill Book Company, Inc., 1944. Pp. 88. $1.25. 
Food rationing and morale. C. Arnold Anderson. Ames: The Iowa State 
College Press, 1943. Pp. 40. $.20. Pamphlet No. 4 in the Series 

Wartime Farm and Food Policy. 

Introduction to exceptional children. Harry J. Baker. New York: The 
Macmillan Company, 1944. Pp. 496. $3.50. 

Vocational rehabilitation as a career. Sarah Allen Beard. Occupational 
Index, Inc., New York University, New York 3, New York. $.25. 

Opportunities for women. Clara M. Brown and Ruth V. Arnesen. Min- 
neapolis: Burgess Publishing Company, 1944. Pp. 44. $1.25. 

Public thinking on post-war problems. Jerome S. Bruner. National 
Planning Association, 800 Twenty-first St., N. W., Washington 6, 
D.C. $.25. (Planning Pamphlet No. 23.) Discounts for quantity 
orders. 

Vocational interests and job orientation. Harold D. Carter. Stanford 
University: Stanford University Press, 1944. Pp. 90. $1.50. 

Marching home; educational and social adjustment after the war. Morse A. 
Cartwright. Institute of Adult Education, Bureau of Publications, 
Teachers College Columbia a New York, 1944. Pp. iv + 
44. $.25. (Ten or more 20 cents.) 

Attaining maturity. Luella Cole. New York: Farrar & Rinehart, Inc., 
1944. Pp. 212. $2.00. 

Employee evaluation manual for interviewers. Richard A. Fear and Byron 
Jordan. New York: The Psychological Corporation, 1943. Pp. 39. 
$1.75. 

Remedial techniques in basic school subjects. Grace M. Fernald. New 
York: McGraw-Hill Book Company. Pp. 330. $2.75. 

Best books of 1943 on occupational information and guidance. Robert 
Hoppock and others. Occupational Index, Inc., New York Uni- 
versity, New York 3, New York. $.25. 

The technique of handling people. Donald A. and Eleanor C. Laird. 
New York: McGraw-Hill Book Company, 1944. Pp. 139. $1.75. 
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Psychoanalysis today. Edited by Sandor Lorand. New York: Inter- 
national University Press, 1944. Pp. 400. $6.00. 

The war and mental health in England. James M. Mackintosh. New 
York: The Commonwealth Fund, 1944. Pp. 91. $.85. 

Handling personality adjustment in industry. Robert N. McMurray. 
New York: Harper & Bros. Pp. 297. $3.00. 

Principles of democratic personnel relationships in administration. Hugh 
M. Shafer. School of Education, University of Oregon, Eugene, 
Oregon. Pp. 8. §$.15. 

Careers for girls in science and engineering. Evelyn Steele. New York: 
E. P. Dutton, 1943. Pp. 181. $2.50. 

Non-language multi-mental test. E. L. Terman, W. A. McCall, Irving 
Lorge. New York: Bureau of Publications, Teachers College, 
Columbia University, 1942. $3.15 per hundred. 

Young men and machines. Raymond F. Yates. New York: Dodd, 
Mead & Company, 1944. Pp. 196. $2.00. 

The dictionary of occupational titles supplement, Edition II, July, 1943. 


Washington, D.C.: Superintendent of Documents, Government Print- 
ing Office, $.60. 
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